[eerie instrumental music playing]
‎（“进入凡人生活的一切强大之物 ‎无不具有弊端”）
‎（——索福克勒斯）
[interviewer] Why don't you go ahead? Sit down and see if you can get comfy.
‎好 你直接开始吧？ ‎好 坐下 能否舒适地坐着
‎还好吗？好了
-You good? All right. -Yeah. [exhales]
‎是
-[interviewer] Um... -[cell phone vibrates]
‎第一镜 打板
[crew member] Take one, marker.
[interviewer] Wanna start by introducing yourself?
‎要我先从自我介绍开始吗？
[crew member coughs]
‎世界你好 贝利 第三镜
Hello, world. Bailey. Take three.
‎-可以了吗？ ‎-这是我最讨厌的部分 兄弟
-[interviewer] You good? -This is the worst part, man.
[chuckling] I don't like this.
‎我不喜欢这样
‎我2011年到2012年间在脸书工作
I worked at Facebook in 2011 and 2012.
‎我是Instagram非常早期的员工
I was one of the really early employees at Instagram.
‎我曾任职于谷歌、YouTube
[man 1] I worked at, uh, Google, uh, YouTube.
‎苹果、谷歌、推特、Palm
[woman] Apple, Google, Twitter, Palm.
‎我帮助创始了Mozilla Labs ‎后来更多工作于火狐这边
I helped start Mozilla Labs and switched over to the Firefox side.
‎在拍吗？大家…
-[interviewer] Are we rolling? Everybody? -[crew members reply]
‎很好
[interviewer] Great.
‎我曾在推特工作 我在推特的 ‎最后一份岗位 是高级副总工程师
[man 2] I worked at Twitter.
My last job there
was the senior vice president of engineering.
-[man 3] I was the president of Pinterest. -[sips]
‎我曾是Pinterest的总经理
‎在那之前 我在脸书做了五年的
Before that, um, I was the... the director of monetization
‎盈利总监
at Facebook for five years.
‎在推特期间 我用了几年时间 ‎运营他们的开发者平台
While at Twitter, I spent a number of years running their developer platform,
‎然后我做了消费者产品部长
and then I became head of consumer product.
‎我曾合作发明 ‎谷歌硬盘、谷歌邮箱聊天
I was the coinventor of Google Drive, Gmail Chat,
‎脸书网页和脸书“赞”按钮
Facebook Pages, and the Facebook like button.
‎对 所以我才花了八个月的时间
Yeah. This is... This is why I spent, like, eight months
‎和律师反复周旋
talking back and forth with lawyers.
‎真的让我很崩溃
This freaks me out.
‎我在那里任职的时候 一直觉得 ‎总体上 这是积极的力量
[man 2] When I was there,
I always felt like, fundamentally, it was a force for good.
‎我现在不确定 自己是否还这样想了
I don't know if I feel that way anymore.
‎出于对道德伦理的担心 ‎我于2017年6月离开谷歌
I left Google in June 2017, uh, due to ethical concerns.
‎不仅是担心谷歌的道德伦理 ‎而是对整个产业
And... And not just at Google but within the industry at large.
‎我很担心
I'm very concerned.
‎非常担心
‎如今 人们很容易忽略一个事实
It's easy today to lose sight of the fact
‎这些工具 ‎其实为世界创造了一些美好的东西
that these tools actually have created some wonderful things in the world.
‎它们让失去联系的家人重聚 ‎找器官捐赠者
They've reunited lost family members. They've found organ donors.
‎它们为整个世界带来了
I mean, there were meaningful, systemic changes happening
‎有意义的、系统的变革
around the world because of these platforms
‎这是这些平台积极的一面
that were positive!
‎我认为我们对它的消极一面 ‎过度看轻了
I think we were naive about the flip side of that coin.
‎对 这些东西 只要你发布 ‎它们自己就会存活
Yeah, these things, you release them, and they take on a life of their own.
‎它们被使用的方式 ‎与你当初的预期大相径庭
And how they're used is pretty different than how you expected.
‎我深信 这些负面的后果 ‎不是任何人刻意为之
Nobody, I deeply believe, ever intended any of these consequences.
‎没有任何一个坏人 没有 绝对没有
There's no one bad guy. No. Absolutely not.
[interviewer] So, then, what's the... what's the problem?
‎那么问题在哪里？
[interviewer] Is there a problem, and what is the problem?
‎是否有问题？问题在哪里？
[swallows]
[clicks tongue] Yeah, it is hard to give a single, succinct...
‎是 很难给出一个单一的、简明的…
I'm trying to touch on many different problems.
‎我在试着谈论很多不同的问题
[interviewer] What is the problem?
‎问题在哪里？
[clicks tongue, chuckles]
[birds singing]
‎NETFLIX 原创纪录片
[dog barking in distance]
[reporter 1] Despite facing mounting criticism,
‎虽然面对越来越多的质疑
‎这些所谓的大型技术公司却越发壮大
the so-called Big Tech names are getting bigger.
‎整个技术产业 ‎正在面临全新维度的审查
The entire tech industry is under a new level of scrutiny.
‎一项新的研究初步揭示了心理健康
And a new study sheds light on the link
‎与社交媒体使用之间的联系
between mental health and social media use.
‎来谈谈最新的研究…
[on TV] Here to talk about the latest research...
[Tucker Carlson] ...is going on that gets no coverage at all.
‎…的情况 根本没有保险
‎数千万美国人无望地
Tens of millions of Americans are hopelessly addicted
‎玩电子设备成瘾
to their electronic devices.
‎因为技术 现在你真的能把自己 ‎隔离在一个泡泡内 周围都是
[reporter 2] It's exacerbated by the fact
that you can literally isolate yourself now
‎（你的朋友在照片中圈出了你）
‎与你观点相似的人 ‎瘾性就更加恶化了
in a bubble, thanks to our technology.
‎虚假新闻变得更发达了
Fake news is becoming more advanced
‎威胁着全世界的社会
and threatening societies around the world.
‎我们12年多以前创造推特的时候 ‎根本没有想到这些
We weren't expecting any of this when we created Twitter over 12 years ago.
White House officials say they have no reason to believe
‎官方说 他们没有理由相信
‎俄罗斯网络攻击会停止
the Russian cyberattacks will stop.
‎YouTube被迫专注于清理网站
YouTube is being forced to concentrate on cleansing the site.
‎如果你和十几岁的孩子去聊
[reporter 3] TikTok, if you talk to any tween out there...
‎他们是绝对不可能删除抖音的…
[on TV] ...there's no chance they'll delete this thing...
‎喂 艾拉 可以帮忙摆桌子吗？
Hey, Isla, can you get the table ready, please?
[reporter 4] There's a question about whether social media
‎有一个严肃的问题
‎社交媒体是否让您的孩子抑郁
is making your child depressed.
‎艾拉 可以帮忙摆桌子吗？
[mom] Isla, can you set the table, please?
‎整容在青少年中已经十分受欢迎
[reporter 5] These cosmetic procedures are becoming so popular with teens,
‎整容医生甚至造出了一种新病征
plastic surgeons have coined a new syndrome for it,
‎“图片分享畸形征” ‎指的是年轻的患者想做整容手术
"Snapchat dysmorphia," with young patients wanting surgery
‎让自己看上去 ‎更接近加了滤镜的自拍中的样子
so they can look more like they do in filtered selfies.
‎我还是不明白 ‎你为什么让她用那东西
Still don't see why you let her have that thing.
‎我能怎么办？
What was I supposed to do?
I mean, every other kid in her class had one.
‎我是说 她们班上的其他孩子全都有
‎她才11岁
She's only 11.
‎卡桑 没人强迫你用
Cass, no one's forcing you to get one.
‎你想和别人切断联系多久 都随你
You can stay disconnected as long as you want.
‎喂 我没有手机也不会和别人 ‎切断联系 好吗？我现在就在网上
Hey, I'm connected without a cell phone, okay? I'm on the Internet right now.
‎而且 这根本不是实际的联系 ‎全都是没用的…
Also, that isn't even actual connection. It's just a load of sh--
‎监视资本主义 ‎已经形成了我们的政治和文化
Surveillance capitalism has come to shape
our politics and culture in ways many people don't perceive.
‎而很多人根本没有察觉
[reporter 6] ISIS inspired followers online,
‎伊斯兰国煽动网上的关注者
‎现在 白人至上主义也在这样做
and now white supremacists are doing the same.
‎最近在印度
Recently in India,
‎网络暴民害死了十几个人 ‎包括这五个…
Internet lynch mobs have killed a dozen people, including these five...
‎虚假新闻不只是虚假新闻 ‎是有后果的
[reporter 7] It's not just fake news; it's fake news with consequences.
‎在虚假新闻的时代 ‎你要怎么解决传染病？
[reporter 8] How do you handle an epidemic in the age of fake news?
‎吃中餐会感染新冠病毒吗？
Can you get the coronavirus by eating Chinese food?
‎我们已经从信息时代 ‎过渡到了虚假信息时代
We have gone from the information age into the disinformation age.
‎我们的民主受到了攻击
Our democracy is under assault.
‎我说的是：“我认为如今 ‎创造出的工具正在开始
[man 4] What I said was, "I think the tools
that have been created today are starting
‎侵蚀社会正常运转的社交纽带”
to erode the social fabric of how society works."
[eerie instrumental music continues]
-[music fades] -[indistinct chatter]
[crew member] Fine.
‎阿莎愿意接受评论 我们播放视频
[stage manager] Aza does welcoming remarks. We play the video.
‎然后说 “女士们先生们 ‎我是特里斯坦·哈里斯”
And then, "Ladies and gentlemen, Tristan Harris."
‎-好 ‎-很好
-Right. -[stage manager] Great.
‎就是说 我上来 然后…
So, I come up, and...
‎（人道 技术的新议程）
‎你就说“欢迎各位的到来”
basically say, "Thank you all for coming." Um...
‎今天 我想聊聊技术的一个新议程
So, today, I wanna talk about a new agenda for technology.
‎以及我们为什么要这样做 ‎因为如果你问人们
And why we wanna do that is because if you ask people,
‎“如今的技术产业怎么了？”
"What's wrong in the tech industry right now?"
there's a cacophony of grievances and scandals,
‎有一种不满和丑闻的杂音
‎“他们盗用了我们的数据” ‎还有技术成瘾问题
and "They stole our data." And there's tech addiction.
‎有虚假新闻问题 有两极分化问题
And there's fake news. And there's polarization
‎有些竞选过程被黑客操控的问题
and some elections that are getting hacked.
‎但是这些问题的背后 ‎是否有一个原因
But is there something that is beneath all these problems
‎导致这些问题在同时发生？
that's causing all these things to happen at once?
[stage manager speaking indistinctly]
‎-感觉还行吗？ ‎-非常好 好
-Does this feel good? -Very good. Yeah.
Um... [sighs]
I'm just trying to... Like, I want people to see...
‎我只是想… 我想让人们看到…
‎在技术产业 正面临着一个问题
Like, there's a problem happening in the tech industry,
and it doesn't have a name,
‎这个问题连名字都没有 ‎这个问题有一个源头…
and it has to do with one source, like, one...
[eerie instrumental music playing]
‎环顾你身边 ‎感觉这个世界在逐渐疯狂
[Tristan] When you look around you, it feels like the world is going crazy.
‎你要问自己 这是正常的吗？
You have to ask yourself, like, "Is this normal?
‎还是我们都中了什么魔咒？
Or have we all fallen under some kind of spell?"
‎（特里斯坦·哈里斯 ‎谷歌前设计道德伦理学家）
‎（人道技术中心 合作创始人）
‎我希望更多的人能够理解它的原理
I wish more people could understand how this works
‎因为它不应该 ‎只被技术产业的业内知道
because it shouldn't be something that only the tech industry knows.
‎应该让所有人都知道
It should be something that everybody knows.
[backpack zips]
[softly] Bye.
[guard] Here you go, sir.
‎-你好！ ‎-嗨！
-[employee] Hello! -[Tristan] Hi.
-Tristan. Nice to meet you. -It's Tris-tan, right?
‎-特里斯坦 幸会 ‎-特里斯坦？
‎-对 ‎-太好了 好
-Yes. -Awesome. Cool.
‎特里斯坦·哈里斯 ‎是谷歌前设计道德伦理学家
[presenter] Tristan Harris is a former design ethicist for Google
‎被称为硅谷最接近良知的人物
and has been called the closest thing Silicon Valley has to a conscience.
‎他呼吁技术产业
[reporter] He's asking tech
‎在产品中引进 ‎被他称为“道德伦理设计”的要素
to bring what he calls "ethical design" to its products.
‎搞技术的业内人士 ‎极少如此直言不讳
[Anderson Cooper] It's rare for a tech insider to be so blunt,
‎特里斯坦·哈里斯相信 ‎总有人要这样
but Tristan Harris believes someone needs to be.
‎我在谷歌工作的时候
[Tristan] When I was at Google,
‎我在谷歌邮箱团队 ‎我就开始觉得很疲惫
I was on the Gmail team, and I just started getting burnt out
‎因为我们讨论了很多…
'cause we'd had so many conversations about...
‎收件箱应该长什么样 ‎应该是什么颜色
you know, what the inbox should look like and what color it should be, and...
‎我自己感觉对邮件成瘾
And I, you know, felt personally addicted to e-mail,
‎我觉得有趣的是
and I found it fascinating
‎在谷歌邮箱工作的人 ‎没有一个想把它做得不那么致瘾
there was no one at Gmail working on making it less addictive.
‎我想：“别人想过这个问题吗？
And I was like, "Is anybody else thinking about this?
‎我 没听谁谈论过这个问题”
I haven't heard anybody talk about this."
‎我对技术产业整体感到沮丧
-And I was feeling this frustration... -[sighs]
...with the tech industry, overall,
‎感觉我们有点迷路了
that we'd kind of, like, lost our way.
-[ominous instrumental music playing] -[message alerts chiming]
‎我真的很努力地去尝试 想办法
[Tristan] You know, I really struggled to try and figure out
‎怎样能从行业内部改变这个问题
how, from the inside, we could change it.
[energetic piano music playing]
‎就在这个时候 我决定做一次展示 ‎算是号召大家吧
[Tristan] And that was when I decided to make a presentation,
kind of a call to arms.
‎每天我回到家 每一个晚上 ‎都要花几个小时去做这件事
Every day, I went home and I worked on it for a couple hours every single night.
[typing]
‎我的呼吁是 历史上从来没有过50个
[Tristan] It basically just said, you know,
never before in history have 50 designers--
‎20到35岁之间的加州白人设计师
20- to 35-year-old white guys in California--
‎做出一个能影响20亿人的决定
made decisions that would have an impact on two billion people.
‎20亿人将会拥有 ‎他们从来不曾预料的想法
Two billion people will have thoughts that they didn't intend to have
‎只因为一个谷歌的设计师说 ‎“你每天早上醒来
because a designer at Google said, "This is how notifications work
‎屏幕上的通知就是这样工作的”
on that screen that you wake up to in the morning."
‎我们作为谷歌 ‎有解决这个问题的道德责任
And we have a moral responsibility, as Google, for solving this problem.
‎我把这个展示
And I sent this presentation
‎发给了在谷歌 ‎与我关系最近的15到20个同事
to about 15, 20 of my closest colleagues at Google,
‎我很紧张 我不知道他们会怎样想
and I was very nervous about it. I wasn't sure how it was gonna land.
‎我第二天去上班的时候
When I went to work the next day,
‎多数的电脑上都开着这个展示
most of the laptops had the presentation open.
‎（注意）
‎那天下午 有400个人同时观看
Later that day, there was, like, 400 simultaneous viewers,
‎看到的人越来越多
so it just kept growing and growing.
‎我收到整个公司同事发来的各种邮件
I got e-mails from all around the company. I mean, people in every department saying,
‎每一个部门的人都说
‎“我太同意了 ‎我看到这个问题正在影响我的孩子
"I totally agree." "I see this affecting my kids."
‎我看到这个问题正在影响我身边的人 ‎我们应该做点什么 来解决这个问题”
"I see this affecting the people around me."
"We have to do something about this."
‎我感觉自己 ‎好像开启了一场革命之类的
It felt like I was sort of launching a revolution or something like that.
‎后来 我才知道莱利·佩吉 ‎那一天在三个不同会议
Later, I found out Larry Page had been notified about this presentation
‎都被人告知这个展示的存在
-in three separate meetings that day. -[indistinct chatter]
‎于是这个展示 ‎创造了这个文化性的时刻
[Tristan] And so, it created this kind of cultural moment
‎谷歌需要认真对待
-that Google needed to take seriously. -[whooshing]
‎然后…杳无音讯了
-[Tristan] And then... nothing. -[whooshing fades]
[message alerts chiming]
‎2006年 所有人…
[Tim] Everyone in 2006...
‎包括我们在脸书的所有人
including all of us at Facebook,
‎超级羡慕谷歌 ‎羡慕谷歌所创建的一切
just had total admiration for Google and what Google had built,
‎超级实用的服务
which was this incredibly useful service
‎据我们当时所知 ‎为世界带来了很多好处
that did, far as we could tell, lots of goodness for the world,
‎他们建立了一个平行的造钱机器
and they built this parallel money machine.
‎我们超级羡慕嫉妒谷歌 ‎在我们看来太优雅了…
We had such envy for that, and it seemed so elegant to us...
‎太完美了
and so perfect.
‎脸书当时才成立大概两年
Facebook had been around for about two years,
um, and I was hired to come in and figure out
‎我被雇到脸书 去找出
‎公司未来要走怎样的商业模式
what the business model was gonna be for the company.
‎我曾是盈利总监 大概意思就是
I was the director of monetization. The point was, like,
‎“你是要去想出 ‎这个东西怎样盈利的人”
"You're the person who's gonna figure out how this thing monetizes."
‎当时很多人做了很多工作
And there were a lot of people who did a lot of the work,
‎但我明显是其中一个指向…
but I was clearly one of the people who was pointing towards...
‎首先 我们必须要赚钱
"Well, we have to make money, A...
‎我认为这个广告模式 ‎可能是最优雅的方式
and I think this advertising model is probably the most elegant way.
[bright instrumental music playing]
Uh-oh. What's this video Mom just sent us?
‎妈妈刚给我们发的什么视频？
Oh, that's from a talk show, but that's pretty good.
‎一个脱口秀 不过挺不错的 ‎那个人还算是个天才
Guy's kind of a genius.
‎他在谈论删除社交媒体 ‎你们真应该这样做
He's talking all about deleting social media, which you gotta do.
‎我可能要开始屏蔽她的邮件了
I might have to start blocking her e-mails.
‎讲真 我都不知道她在说什么 ‎天啊 她还不如我
I don't even know what she's talking about, man.
She's worse than I am.
‎-不 她只用来找菜谱 ‎-对 还有工作
-No, she only uses it for recipes. -Right, and work.
-And workout videos. -[guy] And to check up on us.
‎-还有健身视频 ‎-还看我们在做什么
‎还看她这辈子遇到过的每一个人 ‎在做什么
And everyone else she's ever met in her entire life.
‎如果你一边往下划着 ‎你的社交媒体推送
If you are scrolling through your social media feed
‎一边看着我们 ‎你需要把你该死的手机放下 听好
while you're watchin' us, you need to put the damn phone down and listen up
‎因为我们的下一位嘉宾 ‎写了一本优秀的书
'cause our next guest has written an incredible book
‎书的内容是社交媒体 ‎多大程度上破坏了我们的生活
about how much it's wrecking our lives.
‎掌声有请《立刻删除 ‎你社交媒体的十个论点》作者
Please welcome author
of Ten Arguments for Deleting Your Social Media Accounts Right Now...
-[Sunny Hostin] Uh-huh. -...Jaron Lanier.
‎贾伦·拉尼尔
[cohosts speaking indistinctly]
‎谷歌、脸书这样的公司是有史以来
[Jaron] Companies like Google and Facebook are some of the wealthiest
‎最富有、最成功的几个公司
and most successful of all time.
Uh, they have relatively few employees.
‎他们的员工数量相对较少
‎他们只有一个大电脑 在那里摇钱
They just have this giant computer that rakes in money, right? Uh...
‎问题是 别人为什么给他们钱呢？ ‎这是一个非常重要的问题
Now, what are they being paid for?
[chuckles] That's a really important question.
‎我做了35年的技术产业投资者
[Roger] So, I've been an investor in technology for 35 years.
‎硅谷的前50年 行业制造产品…
The first 50 years of Silicon Valley, the industry made products--
‎硬件、软件 卖给顾客 ‎简单良好的商业模式
hardware, software--
sold 'em to customers. Nice, simple business.
‎过去十年 硅谷最大的公司
For the last ten years, the biggest companies in Silicon Valley
‎一直涉足贩卖他们用户的勾当
have been in the business of selling their users.
‎现在这样说 有点陈词滥调
It's a little even trite to say now,
‎但因为我们不为使用这些产品付钱
but... because we don't pay for the products that we use,
‎广告商为我们使用的产品付钱
advertisers pay for the products that we use.
‎广告商是顾客
Advertisers are the customers.
‎我们是被销售的商品
We're the thing being sold.
‎经典的说法是
The classic saying is:
‎“如果你没有花钱买产品 ‎那你就是被卖的产品”
"If you're not paying for the product, then you are the product."
‎（你就是被卖的产品）
‎很多人想：“谷歌只是一个搜索框
A lot of people think, you know, "Oh, well, Google's just a search box,
‎脸书只是一个看我朋友们在做什么
and Facebook's just a place to see what my friends are doing
‎看他们照片的地方”
and see their photos."
‎但他们没有意识到的是 ‎他们在竞争你的关注
But what they don't realize is they're competing for your attention.
‎脸书、阅后即焚图片分享、推特 ‎Instagram、YouTube
So, you know, Facebook, Snapchat, Twitter, Instagram, YouTube,
‎这种公司 他们的商业模式 ‎是让人们的注意力持续吸引在屏幕上
companies like this, their business model is to keep people engaged on the screen.
‎我们来想办法 怎样尽最大可能
Let's figure out how to get as much of this person's attention
‎获得这个人的注意力
as we possibly can.
‎我们能让你在上面花多少时间？
How much time can we get you to spend?
‎我们能让你给我们分出 ‎你人生的多少时间？
How much of your life can we get you to give to us?
[Justin] When you think about how some of these companies work,
‎当你去想 这些公司是怎样运作的
‎就能开始想通了
it starts to make sense.
‎网络上有过各种服务 ‎我们都认为是免费的
There are all these services on the Internet that we think of as free,
‎但它们并不是免费的 ‎是广告商在付钱
but they're not free. They're paid for by advertisers.
‎广告商为什么给这些公司付钱？
Why do advertisers pay those companies?
‎它们付钱 交换给你展示广告
They pay in exchange for showing their ads to us.
‎我们是产品 我们的关注 ‎就是卖给广告商的产品
We're the product. Our attention is the product being sold to advertisers.
‎这样说 过于简单化了
That's a little too simplistic.
‎产品其实是我们行为和认知的
It's the gradual, slight, imperceptible change
‎逐渐的、一点一点的 ‎我们未察觉到的变化
in your own behavior and perception that is the product.
‎（行为和认知的 变化）
‎这才是产品 是唯一可能的产品
And that is the product. It's the only possible product.
‎这其中 没有任何东西 ‎能再被称为产品了
There's nothing else on the table that could possibly be called the product.
‎这是他们能拿来赚钱的唯一东西
That's the only thing there is for them to make money from.
‎改变你做的事
Changing what you do,
‎你的思维模式 改变你这个人
how you think, who you are.
‎这是一种逐渐的变化 非常轻微
It's a gradual change. It's slight.
‎如果你去找一个人 ‎你说：“给我一千万美元
If you can go to somebody and you say, "Give me $10 million,
‎我会让世界往你希望的方向改变1%…”
and I will change the world one percent in the direction you want it to change..."
It's the world! That can be incredible, and that's worth a lot of money.
‎是整个世界！这就很神奇 值很多钱
‎好
Okay.
‎这是每种商业都一直梦想的
[Shoshana] This is what every business has always dreamt of:
‎就是投放一个广告 ‎有一定能够成功的保证
to have a guarantee that if it places an ad, it will be successful.
‎这就是他们的生意 ‎他们卖的是确定性
That's their business.
They sell certainty.
‎（确定性）
‎为了在这个生意中成功
In order to be successful in that business,
‎你必须要有优秀的预判能力
you have to have great predictions.
‎（优秀的预判能力）
Great predictions begin with one imperative:
‎优秀的预判能力始于一个必要条件
‎你需要很多数据
you need a lot of data.
‎（数据）
‎很多人把它称作监视资本主义
Many people call this surveillance capitalism,
‎资本主义利用大型技术公司 ‎对每个人去的每一个地方
capitalism profiting off of the infinite tracking
‎进行无限追踪获利
of everywhere everyone goes by large technology companies
‎大型技术公司的商业模式
whose business model is to make sure
‎是保证广告商能尽最大可能成功
that advertisers are as successful as possible.
‎这是现在的一种新市场
This is a new kind of marketplace now.
‎这种市场 以前从未出现过
It's a marketplace that never existed before.
‎这个市场交易的 只有人类期货
And it's a marketplace that trades exclusively in human futures.
‎就像交易五花肉期货 ‎和石油期货的市场
Just like there are markets that trade in pork belly futures or oil futures.
‎我们现在有了 ‎交易大范围人类期货的市场
We now have markets that trade in human futures at scale,
‎这些市场创造了万亿美元
and those markets have produced the trillions of dollars
‎让网络公司成为了人类历史上
that have made the Internet companies the richest companies
‎最富有的公司
in the history of humanity.
[indistinct chatter]
[Jeff] What I want people to know is that everything they're doing online
‎我想让人们知道的是 ‎他们在网上做的一切
is being watched, is being tracked, is being measured.
‎都被监控着 被追踪着 被评估着
‎你所做出的每一个行为 ‎都被小心翼翼地监控着、记录着
Every single action you take is carefully monitored and recorded.
‎具体到你停在哪一张图片上看了 ‎你看了多久
Exactly what image you stop and look at, for how long you look at it.
‎是的 真的 看了多久都记录了
Oh, yeah, seriously, for how long you look at it.
‎（纳维亚 参与时间）
[monitors beeping]
‎（瑞恩 参与时间）
‎（雷恩 参与时间）
‎人们孤独的时候 他们知道 ‎人们抑郁的时候 他们知道
[Tristan] They know when people are lonely.
They know when people are depressed.
‎人们看前任爱侣的时候 他们知道
They know when people are looking at photos of your ex-romantic partners.
‎你深夜在做什么 他们知道 ‎他们全都知道
They know what you're doing late at night. They know the entire thing.
‎你是内向还是外向
Whether you're an introvert or an extrovert,
‎你的神经哪种类型 ‎你的性格是哪种类型
or what kind of neuroses you have, what your personality type is like.
‎他们所掌握的我们的信息
[Shoshana] They have more information about us
‎超越人类历史上所有的想象
than has ever been imagined in human history.
‎这是史无前例的
It is unprecedented.
‎所有这些我们不经意间 ‎不断流露出的数据
And so, all of this data that we're... that we're just pouring out all the time
‎都被输入到这些系统中 ‎几乎不用人类看管
is being fed into these systems that have almost no human supervision
‎会做出越来越好的预判
and that are making better and better and better and better predictions
‎预判出我们要做什么 ‎我们是怎样的人
about what we're gonna do and... and who we are.
[indistinct chatter]
‎（为您推荐）
[Aza] People have the misconception it's our data being sold.
‎很多人有一种误解 认为被卖掉的 ‎是我们的数据
‎脸书的商业兴趣 ‎肯定不是放掉这些数据
It's not in Facebook's business interest to give up the data.
‎他们用这些数据做什么呢？
What do they do with that data?
[console whirring]
‎他们做出预判我们行为的模型
[Aza] They build models that predict our actions,
‎拥有最优秀模型的公司就赢了
and whoever has the best model wins.
‎他向下滑网页的速度慢
His scrolling speed is slowing.
‎接近他平均阅读一屏时间长度的末尾 ‎减少广告加载
Nearing the end of his average session length.
Decreasing ad load.
‎把朋友和家人弄回来
Pull back on friends and family.
[Tristan] On the other side of the screen,
‎在屏幕的另一端
‎他们就好像拥有一个 ‎我们的巫毒娃娃化身一样
it's almost as if they had this avatar voodoo doll-like model of us.
‎我们做过的所有事情
All of the things we've ever done,
‎点击过的每一个地方
all the clicks we've ever made,
‎我们看过的所有视频 ‎点赞过的所有内容
all the videos we've watched, all the likes,
‎这些数据都会被返回去 ‎用来建造一个越来越精准的模型
that all gets brought back into building a more and more accurate model.
‎一旦有了这个模型
The model, once you have it,
‎就能预判这个人做怎样的事
you can predict the kinds of things that person does.
‎好 让我测试一下
Right, let me just test.
‎你将要去哪里
[Tristan] Where you'll go. I can predict what kind of videos
‎我能预判出 ‎你会继续看什么样的视频
will keep you watching.
‎我能预判 ‎什么样的情感更能让你产生共鸣
I can predict what kinds of emotions tend to trigger you.
‎好 完美
[blue AI] Yes, perfect.
‎年度最悲壮失败
The most epic fails of the year.
‎（悲壮失败）
-[crowd groans on video] -[whooshes]
‎-完美 有效果 ‎-接着另一个视频
-Perfect. That worked. -Following with another video.
‎漂亮 在它开始之前 ‎我们插进去一个运动鞋广告
Beautiful. Let's squeeze in a sneaker ad before it starts.
[Tristan] At a lot of technology companies,
‎很多这种技术公司有三个主要目标
there's three main goals.
‎有一个参与度目标 ‎增加你的使用 让你一直滑动屏幕
There's the engagement goal:
to drive up your usage, to keep you scrolling.
‎有一个增长目标
There's the growth goal:
‎让你不断回来 尽可能多地邀请朋友
to keep you coming back and inviting as many friends
‎让他们再邀请更多的朋友
and getting them to invite more friends.
‎还有一个广告目标 ‎确保一切按照预期发展
And then there's the advertising goal:
to make sure that, as all that's happening,
‎我们尽量多地从广告上挣钱
we're making as much money as possible from advertising.
[console beeps]
Each of these goals are powered by algorithms
‎每一个目标都由一个算法驱动
‎算法的作用是找出 给你展示什么
whose job is to figure out what to show you
‎让数据上涨
to keep those numbers going up.
‎我们在脸书 经常聊到这个想法
We often talked about, at Facebook, this idea
‎能够按照我们的需要调控
of being able to just dial that as needed.
‎我们聊过 让马克来调控
And, you know, we talked about having Mark have those dials.
‎“喂 我今天想让韩国的用户增加”
"Hey, I want more users in Korea today."
‎开始调控
"Turn the dial."
‎“我们调控提高一点广告”
"Let's dial up the ads a little bit."
‎“调控提高一点盈利”
"Dial up monetization, just slightly."
‎所以说…
And so, that happ--
‎所有这些公司 ‎都能做到这种程度的精准
I mean, at all of these companies, there is that level of precision.
‎-兄弟 怎么… ‎-我不知道我怎么没有得到黄牌罚下
-Dude, how-- -I don't know how I didn't get carded.
‎-那个裁判真是逊 ‎-真的是一直…
-That ref just, like, sucked or something. -You got literally all the way...
‎-那是瑞贝卡 去和她说话 ‎-我知道那是谁
-That's Rebecca. Go talk to her. -I know who it is.
‎-兄弟 去啊 去跟她说话 ‎-我正在努力
-Dude, yo, go talk to her. -[guy] I'm workin' on it.
‎他的日历上说 他正在休假 ‎我们应该实时操作
His calendar says he's on a break right now. We should be live.
[sighs] Want me to nudge him?
‎要我给他发一个窗口抖动吗？
‎好 抖吧
Yeah, nudge away.
[console beeps]
"Your friend Tyler just joined. Say hi with a wave."
‎“您的好友泰勒刚刚加入了 ‎去挥手打个招呼吧”
‎快啊 兄弟
[Engagement AI] Come on, Ben.
‎发一个挥手
Send a wave. [sighs]
‎你都没有… 去和她说话 兄弟
-You're not... Go talk to her, dude. -[phone vibrates, chimes]
‎您的好友泰勒刚刚加入了！ ‎挥手打个招呼吧
-[Ben sighs] -[cell phone chimes]
‎（联系人网络）
[console beeps]
‎新联系人！好 连上了
New link! All right, we're on. [exhales]
‎接下来推送 ‎用户079044238820瑞贝卡的发帖
Follow that up with a post from User 079044238820, Rebecca.
‎好主意 卫星定位坐标显示 ‎他们距离很近
Good idea. GPS coordinates indicate that they're in close proximity.
‎（瑞贝卡 找到了我的灵魂伴侣 ‎#闺蜜#呲溜呲溜#好朋友）
‎他容易受到广告影响
He's primed for an ad.
‎拍卖时间
Auction time.
‎（广告预览 深度衰落发蜡）
‎卖了！给深度衰落发蜡
Sold! To Deep Fade hair wax.
‎我们有468个感兴趣的竞标人 ‎我们以3.262分卖给本 换来他的印象
We had 468 interested bidders. We sold Ben at 3.262 cents for an impression.
[melancholy piano music playing]
[Ben sighs]
‎我们创造了一个世界 ‎这个世界中 在线联系变成了主体
[Jaron] We've created a world
in which online connection has become primary,
‎尤其是对年轻一代
especially for younger generations.
‎然而在这个世界 每次两个人联系
And yet, in that world, any time two people connect,
‎唯一能提供经济支持的 ‎是通过一个鬼祟的第三方
the only way it's financed is through a sneaky third person
‎有人给第三方钱 去操纵这两个人
who's paying to manipulate those two people.
‎所以 我们创造了全球的一整代人
So, we've created an entire global generation of people
‎他们成长的背景中 交流的意义
who are raised within a context where the very meaning of communication,
‎文化的意义 就是操纵
the very meaning of culture, is manipulation.
‎我们所做的每一件事的中心
We've put deceit and sneakiness
at the absolute center of everything we do.
‎都加入了欺骗和鬼祟
‎（“任何足够先进的技术 ‎都极其类似于魔术”）
‎（——亚瑟·C·克拉克）
-[interviewer] Grab the... -[Tristan] Okay.
‎-拿起另一个… ‎-好
‎-放在哪里才有用？ ‎-这样很好
-Where's it help to hold it? -[interviewer] Great.
-[Tristan] Here? -[interviewer] Yeah.
‎-这里？ ‎-好
‎这会怎样出现在摄影机中 ‎如果我要做…
How does this come across on camera if I were to do, like, this move--
‎-其实 我们可以… ‎-就这样？
-[interviewer] We can-- -[blows] Like that?
‎-什么？ ‎-对
-[interviewer laughs] What? -Yeah.
‎-再来一次？ ‎-没错 好
-[interviewer] Do that again. -Exactly. Yeah. [blows]
‎对 不是 可能不是…
Yeah. No, it's probably not...
‎这样… 对
Like... yeah.
‎这个就稍微没那么…
I mean, this one is less...
[interviewer laughs] Larissa's, like, actually freaking out over here.
‎克里斯在那边已经烦死了
‎可以了吗？
Is that good?
‎（魔术！）
[instrumental music playing]
‎我从五岁开始学习变魔术
[Tristan] I was, like, five years old when I learned how to do magic.
‎我可以骗过成年人 ‎有博士学位的完全成熟的成年人
And I could fool adults, fully-grown adults with, like, PhDs.
‎魔术师几乎像是最早期的神经学家
Magicians were almost like the first neuroscientists
‎和心理学家
and psychologists.
‎他们是最先明白
Like, they were the ones who first understood
‎人们思想工作原理的人
how people's minds work.
‎他们在人们身上 ‎实时测试着很多很多的东西
They just, in real time, are testing lots and lots of stuff on people.
‎魔术师懂一些事
A magician understands something,
‎你思想中 ‎你自己都没意识到的某一部分
some part of your mind that we're not aware of.
‎这是让幻觉起作用的关键
That's what makes the illusion work.
‎医生、律师 ‎知道怎样构造747飞机或者核弹的人
Doctors, lawyers, people who know how to build 747s or nuclear missiles,
‎他们并不会比别人更了解 ‎自己的思想有多么脆弱
they don't know more about how their own mind is vulnerable.
‎因为这是一个完全不用的学科领域
That's a separate discipline.
‎这个学科领域 对所有人类都适用
And it's a discipline that applies to all human beings.
‎（斯坦福大学）
From that perspective, you can have a very different understanding
‎从这个角度来说 ‎你就能对技术做了什么
‎有一个不同的理解
of what technology is doing.
‎我在斯坦福劝服技术实验室的时候 ‎这就是我们所学到的
When I was at the Stanford Persuasive Technology Lab,
this is what we learned.
‎怎样利用我们知道的一切心理学知识
How could you use everything we know
‎什么东西能劝服人们
about the psychology of what persuades people
‎把这个运用到技术中？
and build that into technology?
‎在座观众中的很多人 已经是天才了
Now, many of you in the audience are geniuses already.
‎我认为这是事实 但我的目标是 ‎让你们变成行为改变的天才
I think that's true, but my goal is to turn you into a behavior-change genius.
‎很多著名的硅谷人物 ‎都上过这个课
There are many prominent Silicon Valley figures who went through that class--
‎脸书、优步和其他公司的 ‎业绩增长关键人物
key growth figures at Facebook and Uber and... and other companies--
‎学习怎样让技术更能劝服人们
and learned how to make technology more persuasive,
‎特里斯坦就是其中一个
Tristan being one.
‎劝服性技术 可以说是极端应用的
[Tristan] Persuasive technology is just sort of design
‎刻意设计
intentionally applied to the extreme,
‎我们真的想去修改一个人的行为
where we really want to modify someone's behavior.
‎我们想让他们这样做
We want them to take this action.
‎我们想让他们继续用手指这样做
We want them to keep doing this with their finger.
‎你往下拉 刷新 最上面就是新的内容
You pull down and you refresh, it's gonna be a new thing at the top.
‎再下拉 再刷新 又是新的 ‎每一次都是
Pull down and refresh again, it's new. Every single time.
‎在心理学上 我们称为“正积极强化”
Which, in psychology, we call a positive intermittent reinforcement.
‎你不知道什么时候能刷到 ‎或者你是否能刷到什么
You don't know when you're gonna get it or if you're gonna get something,
‎它的原理就像是赌城的老虎机
which operates just like the slot machines in Vegas.
‎你有意识地使用产品 还远远不够
It's not enough that you use the product consciously,
‎我想深度侵入你的大脑根部
I wanna dig down deeper into the brain stem
‎在你脑中植入一个无意识的习惯
and implant, inside of you,
an unconscious habit
‎让你在更深的层次被编程
so that you are being programmed at a deeper level.
‎你自己都没有意识到
You don't even realize it.
‎一个叫做詹姆斯·马歇尔的人
[teacher] A man, James Marshall...
‎每一次你在看到老虎机在柜台上
[Tristan] Every time you see it there on the counter,
‎你看一眼 你知道如果你过去
and you just look at it, and you know if you reach over,
‎它可能有东西给你
it just might have something for you,
‎于是你就玩了一下老虎机 ‎看你能得到什么 对吧？
so you play that slot machine to see what you got, right?
‎这不是偶然 这是设计好的手段
That's not by accident. That's a design technique.
‎他把一个金块 ‎给了旧金山军队的一个军官
[teacher] He brings a golden nugget to an officer
in the army in San Francisco.
‎别忘了 旧金山的人口数量 ‎当时只有…
Mind you, the... the population of San Francisco was only...
‎另一个例子是照片圈人
[Jeff] Another example is photo tagging.
-[teacher] The secret didn't last. -[phone vibrates]
‎如果你收到一封邮件 ‎说你朋友刚刚在一张照片中圈出了你
[Jeff] So, if you get an e-mail
that says your friend just tagged you in a photo,
‎你当然会点击那封邮件 看一下照片
of course you're going to click on that e-mail and look at the photo.
‎这不是你能选择忽略的事情
It's not something you can just decide to ignore.
‎他们所利用的 ‎是根植于人类本性中的东西
This is deep-seated, like,
human personality that they're tapping into.
‎你应该问自己的是
What you should be asking yourself is:
‎“这封邮件中 ‎为什么没把照片放进来？
"Why doesn't that e-mail contain the photo in it?
‎这样 看照片就会容易很多 ”
It would be a lot easier to see the photo."
‎当脸书发现这个功能之后 ‎他们可真是尽情调控
When Facebook found that feature, they just dialed the hell out of that
‎因为他们说 ‎“这将是增长积极性的绝好方式
because they said, "This is gonna be a great way to grow activity.
‎我们让大家整天在照片中互相圈吧”
Let's just get people tagging each other in photos all day long."
[upbeat techno music playing]
‎（本：至少我们中 ‎有一个人拍得很好）
[cell phone chimes]
‎他评论了
He commented.
‎很好
[Growth AI] Nice.
‎瑞贝卡收到了 她正在回复
Okay, Rebecca received it, and she is responding.
‎好 让本知道她在输入 别让他下线了
All right, let Ben know that she's typing so we don't lose him.
‎激活省略号
Activating ellipsis.
‎（至少我们中有一个人拍得很好 ‎…）
[teacher continues speaking indistinctly]
[tense instrumental music playing]
‎太好了 她发布了
Great, she posted.
‎他在评论 他给她发帖的评论的评论
He's commenting on her comment about his comment on her post.
‎等一下 他停止输入了
Hold on, he stopped typing.
‎我们来自动填入
Let's autofill.
‎表情 他喜欢使用表情
Emojis. He loves emojis.
‎（自动完成 参与度）
‎他选择了“火辣”表情
He went with fire.
[clicks tongue, sighs] I was rootin' for eggplant.
‎我以为他会选择茄子呢
‎有一整个学科 ‎这个领域叫做“增长量黑客学”
[Tristan] There's an entire discipline and field called "growth hacking."
‎无数工程师团队 ‎他们的工作就是黑入人们的心理
Teams of engineers whose job is to hack people's psychology
‎让他们拥有更多的增长量
so they can get more growth.
‎他们能得到更多的用户注册 ‎更高的参与度
They can get more user sign-ups, more engagement.
‎能让你邀请更多人
They can get you to invite more people.
‎各种测试、迭代 种种操作之后
After all the testing, all the iterating, all of this stuff,
‎知道我们发现最重要现象是什么吗？
you know the single biggest thing we realized?
‎让任何个体在十天内邀请七个朋友
Get any individual to seven friends in ten days.
‎（查马斯·帕里哈皮提亚 ‎脸书前增长副总裁）
‎就是这个
That was it.
‎查马斯是脸书早期的增长负责人
Chamath was the head of growth at Facebook early on,
‎他在技术领域非常知名
and he's very well known in the tech industry
‎因为他首创了很多增长手段
for pioneering a lot of the growth tactics
‎这些手段的使用 ‎让脸书用户飞速增长
that were used to grow Facebook at incredible speed.
‎后来那些增长手段 ‎变成了硅谷的标准战术
And those growth tactics have then become the standard playbook for Silicon Valley.
‎在优步使用了 ‎在很多其他公司也使用了
They were used at Uber and at a bunch of other companies.
‎他首创的一个东西 ‎就是对功能上的小变化
One of the things that he pioneered was the use of scientific A/B testing
‎使用科学A/B测试
of small feature changes.
‎谷歌和脸书这种公司
Companies like Google and Facebook
‎会推出很多小实验
would roll out lots of little, tiny experiments
‎他们不断在用户身上测试
that they were constantly doing on users.
‎随着时间发展 ‎不停运行这些实验之后
And over time, by running these constant experiments,
‎就能发展出能让用户 ‎做你想让他们做的事
you... you develop the most optimal way
‎的最佳方式
to get users to do what you want them to do.
‎这就是操纵
It's... It's manipulation.
‎你让我感觉自己像是实验室的小白鼠
[interviewer] Uh, you're making me feel like a lab rat.
‎你就是实验室的小白鼠 ‎我们所有人都是
You are a lab rat. We're all lab rats.
‎我们和开发治愈癌症药物的 ‎实验室小白鼠又不一样
And it's not like we're lab rats for developing a cure for cancer.
‎这些实验的最终获益人 不是我们
It's not like they're trying to benefit us.
‎对吧？我们就像僵尸一样 ‎他们想让我们看更多的广告
Right? We're just zombies, and they want us to look at more ads
‎让他们挣更多的钱
so they can make more money.
‎脸书做了一个实验 ‎他们称为“海量规模蔓延实验”
[Shoshana] Facebook conducted
what they called "massive-scale contagion experiments."
‎好吧
Okay.
‎我们怎样用脸书页面上的潜意识信号
[Shoshana] How do we use subliminal cues on the Facebook pages
‎来让更多人在中期选举中投票？
to get more people to go vote in the midterm elections?
‎他们发现 他们能做到
And they discovered that they were able to do that.
‎他们得出的一个结论是 ‎现在我们知道
One thing they concluded is that we now know
‎我们能影响现实世界中的行为和情感
we can affect real-world behavior and emotions
‎而根本不用触发用户的意识
without ever triggering the user's awareness.
‎他们自己完全不知道
They are completely clueless.
‎我们将这些人工智能引擎 ‎指回到我们身上
We're pointing these engines of AI back at ourselves
‎来反向编程 什么能引诱我们的回应
to reverse-engineer what elicits responses from us.
‎就很像你在蜘蛛身上模拟神经细胞
Almost like you're stimulating nerve cells on a spider
‎来看是什么引起它的腿反应
to see what causes its legs to respond.
‎就是这种监狱实验
So, it really is this kind of prison experiment
‎我们在实验中 捆绑人们进入矩阵
where we're just, you know, roping people into the matrix,
‎我们从他们的行为中获取金钱和数据 ‎用他们的行为牟利
and we're just harvesting all this money and... and data from all their activity
to profit from.
‎我们甚至都不知道 发生了这些
And we're not even aware that it's happening.
‎我们想在心理学上弄清楚 ‎怎样以最快的速度操纵你
So, we want to psychologically figure out how to manipulate you as fast as possible
‎然后返回给你让你产生兴奋的事物
and then give you back that dopamine hit.
‎我们在脸书做得非常出色
We did that brilliantly at Facebook.
‎Instagram也这样做了 ‎WhatsApp也这样做了
Instagram has done it. WhatsApp has done it.
‎阅后即焚图片分享也这样做了 ‎推特也这样做了
You know, Snapchat has done it. Twitter has done it.
‎这种东西正是
I mean, it's exactly the kind of thing
‎我这种黑客能想出来的
that a... that a hacker like myself would come up with
‎因为你在利用人类心理中的脆弱挣钱
because you're exploiting a vulnerability in... in human psychology.
‎（希恩·帕克 脸书前总经理）
[chuckles] And I just... I think that we...
‎我只是想 我们这些发明者、创造者…
you know, the inventors, creators...
‎有我 有马克 有…
uh, you know, and it's me, it's Mark, it's the...
‎Instagram的凯文·斯特罗姆 ‎所有这些人…
you know, Kevin Systrom at Instagram... It's all of these people...
um, understood this consciously, and we did it anyway.
‎意识里非常清楚 但我们依然利用了
‎自行车问世的时候 没有人不满
No one got upset when bicycles showed up.
‎对吧？所有人都开始用自行车出行
Right? Like, if everyone's starting to go around on bicycles,
‎没有人说 ‎“天啊 我们刚刚毁掉了社会
no one said, "Oh, my God, we've just ruined society.
‎因为自行车能影响人
[chuckles] Like, bicycles are affecting people.
‎拉远了他们和孩子间的距离
They're pulling people away from their kids.
‎他们在毁掉民主的结构 ‎人们无法判断真假了”
They're ruining the fabric of democracy. People can't tell what's true."
‎对于自行车 ‎我们从来没有说过这种话
Like, we never said any of that stuff about a bicycle.
‎如果一个东西是工具 ‎它就会忠诚地坐在那里
If something is a tool, it genuinely is just sitting there,
‎耐心等待
waiting patiently.
‎如果一个东西不是工具 ‎它会在你身上有所求
If something is not a tool, it's demanding things from you.
‎引诱你、操纵你 想从你身上获利
It's seducing you. It's manipulating you. It wants things from you.
‎我们已经走过了 ‎以工具为基础的技术环境
And we've moved away from having a tools-based technology environment
‎来到了以致瘾和操纵 ‎为基础的技术环境
to an addiction- and manipulation-based technology environment.
‎这是技术环境的改变
That's what's changed.
‎社交媒体 ‎不是原地等在那里被使用的工具
Social media isn't a tool that's just waiting to be used.
‎它有自己的目标 ‎有自己的办法去实现这些目标
It has its own goals, and it has its own means of pursuing them
‎利用你的心理 来对付你
by using your psychology against you.
[ominous instrumental music playing]
‎（“只有两个行业 ‎把他们的客户叫做‘使用者’
‎非法毒品和软件”）
‎（——爱德华·塔夫特）
‎回想几年之前 ‎我是Pinterest的总经理
[Tim] Rewind a few years ago, I was the...
I was the president of Pinterest.
‎我回到家 到家之后就无法放下手机
I was coming home,
and I couldn't get off my phone once I got home,
‎虽然我有两个小孩子 需要我的关爱
despite having two young kids who needed my love and attention.
‎我在食物储藏室里打字回邮件
I was in the pantry, you know, typing away on an e-mail
‎有时候会看Pinterest
or sometimes looking at Pinterest.
‎我想：“天啊 这真是典型的讽刺
I thought, "God, this is classic irony.
‎我白天去工作
I am going to work during the day
‎构造一个把我当猎物的东西”
and building something that then I am falling prey to."
‎我无法… 有时候 ‎我真的情不自禁使用
And I couldn't... I mean, some of those moments, I couldn't help myself.
-[notification chimes] -[woman gasps]
‎我最无法摆脱的是推特
The one that I'm... I'm most prone to is Twitter.
Uh, used to be Reddit.
‎以前无法摆脱的是Reddit
‎我后来不得不给自己写程序 ‎来切断我阅读Reddit的瘾
I actually had to write myself software to break my addiction to reading Reddit.
-[notifications chime] -[slot machines whir]
‎我最成瘾的 可能是邮件
I'm probably most addicted to my e-mail.
‎真的 我是认真的 我自己能感觉到
I mean, really. I mean, I... I feel it.
-[notifications chime] -[woman gasps]
[electricity crackles]
‎这很有趣
Well, I mean, it's sort-- it's interesting
‎我很清楚 这一切的幕后发生着什么
that knowing what was going on behind the curtain,
‎我还是无法控制自己去使用
I still wasn't able to control my usage.
‎这就有点可怕了
So, that's a little scary.
‎即便知道这些手段的原理 ‎我还是容易受到它们影响
Even knowing how these tricks work, I'm still susceptible to them.
‎我拿起手机 ‎20分钟就不知不觉过去了
I'll still pick up the phone, and 20 minutes will disappear.
[notifications chime]
-[fluid rushes] -[woman gasps]
‎你晨起排尿之前 ‎会看一眼智能手机吗？
Do you check your smartphone before you pee in the morning
‎或者晨起排尿过程中 会看吗？
or while you're peeing in the morning?
‎因为只有这两个选择
'Cause those are the only two choices.
‎我试过用意志力克制 纯意志力…
I tried through willpower, just pure willpower...
‎“我要放下手机 ‎我到家之后 要把手机丢在车里”
"I'll put down my phone, I'll leave my phone in the car when I get home."
‎我应该在千万个不同的日子 ‎告诉过自己千万次
I think I told myself a thousand times, a thousand different days,
‎“我不要把手机带到卧室”
"I am not gonna bring my phone to the bedroom,"
‎然后晚上九点到了
and then 9:00 p.m. rolls around.
‎“哎 我想把手机带进卧室”
"Well, I wanna bring my phone in the bedroom."
[takes a deep breath] And so, that was sort of...
‎这就有点…
‎意志力是一种努力
Willpower was kind of attempt one,
‎兽性在做着另一种努力
and then attempt two was, you know, brute force.
‎隆重介绍“厨房保险箱”
[announcer] Introducing the Kitchen Safe. The Kitchen Safe is a revolutionary,
‎“厨房保险箱”是革命性的全新发明 ‎帮你战胜诱惑的
new, time-locking container that helps you fight temptation.
‎时间锁保鲜盒
‎大卫只需要把各种诱惑 ‎放进这个“厨房保险箱”
All David has to do is place those temptations in the Kitchen Safe.
‎下一步 进行调控 设置时间
Next, he rotates the dial to set the timer.
‎最后 按下调控 激活锁
And, finally, he presses the dial to activate the lock.
‎“厨房保险箱”超级好
The Kitchen Safe is great...
‎我们家有 是吧？
We have that, don't we?
‎…电子游戏、信用卡、手机
...video games, credit cards, and cell phones.
‎对 有
Yeah, we do.
‎“厨房保险箱”一旦上锁
[announcer] Once the Kitchen Safe is locked, it cannot be opened
‎直到计时器归零之前 没办法打开
until the timer reaches zero.
‎问题是 社交媒体就是一种毒品
[Anna] So, here's the thing.
Social media is a drug.
‎我们有着基本的生物学欲望
I mean, we have a basic biological imperative
‎去和别人联系
to connect with other people.
‎这直接影响着 ‎奖赏通路中的多巴胺释放
That directly affects the release of dopamine in the reward pathway.
‎这个机制背后 是几百万年的进化
Millions of years of evolution, um, are behind that system
‎让我们聚在一起 群居生活
to get us to come together and live in communities,
‎找到伴侣 繁殖我们的物种
to find mates, to propagate our species.
‎所以 毫无疑问 社交媒体这种载体
So, there's no doubt that a vehicle like social media,
‎它会优化人们之间的联系
which optimizes this connection between people,
‎自然会有致瘾的可能性
is going to have the potential for addiction.
-Mmm! [laughs] -Dad, stop!
‎爸 停！
‎我在晚饭前 还有上千个消息要回
I have, like, 1,000 more snips to send before dinner.
‎消息？
-[dad] Snips? -I don't know what a snip is.
‎我不知道消息是什么
-Mm, that smells good, baby. -All right. Thank you.
‎-闻起来好香 宝贝 ‎-谢谢
‎我想 我们可以用所有五官
I was, um, thinking we could use all five senses
‎来享受今晚的晚餐
to enjoy our dinner tonight.
‎所以我决定 ‎今晚的餐桌上不能使用手机
So, I decided that we're not gonna have any cell phones at the table tonight.
‎好了 交上来
So, turn 'em in.
‎-真的吗？ ‎-是
-Really? -[mom] Yep.
‎-好吧 ‎-谢谢 本？
-All right. -Thank you. Ben?
‎-好 ‎-妈妈是手机海盗
-Okay. -Mom, the phone pirate. [scoffs]
‎-拿走了 ‎-妈！
-Got it. -Mom!
So, they will be safe in here until after dinner...
‎晚餐结束前 ‎这些手机会安全地放在这里
‎所有人可以安静待着了 好吗？
-and everyone can just chill out. -[safe whirs]
Okay?
[Cass sighs]
[notification chimes]
‎-我能看一眼是谁吗？ ‎-不行
-Can I just see who it is? -No.
‎我去再拿一个叉子
Just gonna go get another fork.
‎谢谢
Thank you.
‎宝贝 不能打开
Honey, you can't open that.
‎我锁上了一个小时 别动了
I locked it for an hour, so just leave it alone.
‎我们要聊点什么？
So, what should we talk about?
‎我们可以聊聊我今天开车 ‎身边经过的极端中心政党疯子
Well, we could talk
about the, uh, Extreme Center wackos I drove by today.
-[mom] Please, Frank. -What?
‎-算了 弗兰科 ‎-怎么了？
‎我不想聊政治
[mom] I don't wanna talk about politics.
‎-极端中心怎么了？ ‎-看吧？他都没明白
-What's wrong with the Extreme Center? -See? He doesn't even get it.
‎取决于你问谁
It depends on who you ask.
‎这就像是你问：“政治鼓吹怎么了？”
It's like asking, "What's wrong with propaganda?"
-[safe smashes] -[mom and Frank scream]
‎艾拉！
[Frank] Isla!
‎天啊
Oh, my God.
-[sighs] Do you want me to... -[mom] Yeah.
‎-需要我去… ‎-嗯
‎我很担心我的孩子们
[Anna] I... I'm worried about my kids.
‎等你们有了孩子 ‎我还会担心你们的孩子
And if you have kids, I'm worried about your kids.
‎虽然我有着各种知识储备 各种经验
Armed with all the knowledge that I have and all of the experience,
‎我还是和孩子们争论
I am fighting my kids about the time
‎他们使用手机和电脑的时间
that they spend on phones and on the computer.
‎我会对我儿子说 ‎“你觉得自己会在手机上花多久？”
I will say to my son, "How many hours do you think you're spending on your phone?"
‎他会说 ‎“也就半小时吧 最多半小时了”
He'll be like, "It's, like, half an hour. It's half an hour, tops."
‎我觉得比一小时多一点 一个半小时
I'd say upwards hour, hour and a half.
I looked at his screen report a couple weeks ago.
‎几周之前看了他的屏幕使用报告
‎-是3小时45分 ‎-那不是…
-Three hours and 45 minutes. -[James] That...
‎我觉得没有… 平均每天？
I don't think that's... No. Per day, on average?
‎-对 ‎-我现在去拿来吗？
-Yeah. -Should I go get it right now?
‎每一天 我都要提醒我的孩子们
There's not a day that goes by that I don't remind my kids
‎愉悦和痛苦的平衡
about the pleasure-pain balance,
‎多巴胺短缺的状态 上瘾的风险
about dopamine deficit states,
about the risk of addiction.
‎-对 ‎-来揭晓真相
[Mary] Moment of truth.
‎每天2小时50分
Two hours, 50 minutes per day.
‎-我们看看 ‎-其实 我今天用了很多
-Let's see. -Actually, I've been using a lot today.
‎-过去七天 ‎-可能这就是原因
-Last seven days. -That's probably why.
‎Instagram 6小时13分 ‎好吧 我使用Instagram是最严重的
Instagram, six hours, 13 minutes. Okay, so my Instagram's worse.
‎我的屏幕彻底碎了 谢谢你 卡桑
My screen's completely shattered.
Thanks, Cass.
‎“谢谢你 卡桑”是什么意思？
What do you mean, "Thanks, Cass"?
‎你一直让妈妈担心我们的手机问题 ‎但其实这根本不是问题
You keep freaking Mom out about our phones when it's not really a problem.
‎我们吃晚餐不需要手机
We don't need our phones to eat dinner!
‎我明白你说的 ‎但这又不是什么大事 没什么啊
I get what you're saying. It's just not that big a deal. It's not.
‎不是什么大事 那就一周别用手机
If it's not that big a deal, don't use it for a week.
[Ben sighs]
‎对
Yeah. Yeah, actually, if you can put that thing away for, like, a whole week...
‎对 其实 如果你能把那东西 ‎收起来一整周…
‎我就给你买一个新的屏幕
I will buy you a new screen.
-Like, starting now? -[mom] Starting now.
‎-从现在开始吗？ ‎-现在开始
-Okay. You got a deal. -[mom] Okay.
‎好 成交
‎好 不过你要放在这里 小朋友
Okay, you gotta leave it here, though, buddy.
‎好 我把它放进去
All right, I'm plugging it in.
‎计时开始 我退后了
Let the record show... I'm backing away.
‎好
Okay.
‎-计时开始了 ‎-一周
-You're on the clock. -[Ben] One week.
‎天啊…
Oh, my...
‎你觉得他能做到吗？
Think he can do it?
‎不知道 走着瞧
I don't know. We'll see.
‎你吃饭吧 好吗？
Just eat, okay?
‎美好的家庭晚餐！
Good family dinner!
‎这些技术产品不是由
[Tristan] These technology products were not designed
‎努力保护和培育孩子的 ‎儿童心理学家设计的
by child psychologists who are trying to protect and nurture children.
‎它们的设计 是让这些算法
They were just designing to make these algorithms
‎非常擅于给你推荐下一个视频
that were really good at recommending the next video to you
‎非常擅于让你拍照加滤镜
or really good at getting you to take a photo with a filter on it.
‎（两个赞）
‎（确定删除吗？否）
‎（是）
[cell phone chimes]
‎这些东西不仅在控制 ‎他们把注意力花在哪里
[Tristan] It's not just that it's controlling
where they spend their attention.
‎尤其是社交媒体越来越深入大脑根部
Especially social media starts to dig deeper and deeper down into the brain stem
‎夺走孩子们的判断力 ‎自我价值和身份
and take over kids' sense of self-worth and identity.
‎（美化我）
[notifications chiming]
‎（莉莉：可爱！）
‎（索薇娅：天啊 好美）
‎（奥利维亚：你太美了）
‎（阿瓦：你把耳朵P大了吗？）
‎（哈哈）
[Tristan] We evolved to care about whether other people in our tribe...
‎我们进化出 ‎在意我们社群中的其他人…
‎（布里亚纳：漂亮！）
‎…是否对我们有好印象的机制 ‎因为这很重要
think well of us or not 'cause it matters.
‎但我们的进化 需要我们在意 ‎一万个人怎么看我们吗？
But were we evolved to be aware of what 10,000 people think of us?
‎我们的进化
We were not evolved to have social approval being dosed to us
‎不需要每隔五分钟 ‎就获得一次社交认可
every five minutes.
‎这根本不是我们需要去体验的
That was not at all what we were built to experience.
‎我们管理自己的生活 ‎建立在获得的完美感上
[Chamath] We curate our lives around this perceived sense of perfection
‎因为爱心、点赞、竖起大拇指 ‎这些短期的信号
because we get rewarded in these short-term signals--
‎给我们奖赏
hearts, likes, thumbs-up--
‎我们把它融合到价值中 ‎融合到真相中
and we conflate that with value, and we conflate it with truth.
‎不论是否虚假 易破碎的人气
And instead, what it really is is fake, brittle popularity...
‎这是短期的 你需要承认 这让你更加
that's short-term and that leaves you even more, and admit it,
‎空虚 于是会再次这样做
vacant and empty before you did it.
‎因为这样 ‎它会将你逼入这样一个恶性循环
Because then it forces you into this vicious cycle
‎你会想：“我接下来要做什么？ ‎因为我还想要这种感觉”
where you're like, "What's the next thing I need to do now? 'Cause I need it back."
‎想一下 这种现象被20亿人复杂化
Think about that compounded by two billion people,
‎然后想一下 之后人们 ‎会怎样回应别人对自己的看法
and then think about how people react then to the perceptions of others.
‎真的… 真的很恶劣
It's just a... It's really bad.
‎真的太恶劣了
It's really, really bad.
‎美国青少年群体中 ‎出现了大幅增长的
[Jonathan] There has been a gigantic increase
in depression and anxiety for American teenagers
‎抑郁和焦虑
‎大概就在2011年到2013年开始的
which began right around... between 2011 and 2013.
‎这个国家中 每十万名少女中
The number of teenage girls out of 100,000 in this country
‎每年因为割腕或者自残
who were admitted to a hospital every year
‎进医院接受治疗的人数
because they cut themselves or otherwise harmed themselves,
‎在2010年到2011年是非常平稳的
that number was pretty stable until around 2010, 2011,
‎在那之后 直线上升
and then it begins going way up.
‎大一点的少女中 增加了62%
It's up 62 percent for older teen girls.
‎（美国非致命性自残住院人数）
It's up 189 percent for the preteen girls. That's nearly triple.
‎进入青春期前的少女 增加了189% ‎将近三倍了
‎更可怕的是 ‎自杀也呈现出相同的趋势
Even more horrifying, we see the same pattern with suicide.
‎（美国自杀率 ‎每百万女孩死亡人数）
The older teen girls, 15 to 19 years old,
‎大一点的少女 15到19岁
‎与本世纪初相比 增长了70%
they're up 70 percent,
compared to the first decade of this century.
‎青春期前的少女 ‎最开始的比率非常低
The preteen girls, who have very low rates to begin with,
‎现在增长了151%
they are up 151 percent.
‎这个增长模式 指向了社交媒体
And that pattern points to social media.
‎（2009年手机上的社交媒体数量）
‎Z代人 ‎1996年之后那会儿出生的孩子们
Gen Z, the kids born after 1996 or so,
‎那些孩子们是历史上第一代
those kids are the first generation in history
‎在初中开始使用社交媒体的
that got on social media in middle school.
[thunder rumbling in distance]
[Jonathan] How do they spend their time?
‎他们的时间 花在了哪里？
‎他们放学回家 就拿起手机
They come home from school, and they're on their devices.
‎整个一代人都更加焦虑 ‎更加脆弱、更加抑郁
A whole generation is more anxious, more fragile, more depressed.
-[thunder rumbles] -[Isla gasps]
‎他们更不愿意冒险
[Jonathan] They're much less comfortable taking risks.
‎他们拿到驾照的比率下降了
The rates at which they get driver's licenses have been dropping.
‎出去约会过的人数
The number who have ever gone out on a date
‎有过任何形式浪漫互动的人数骤减
or had any kind of romantic interaction is dropping rapidly.
‎整个一代人 有了真正的改变
This is a real change in a generation.
‎别忘了 这些人中的每一个 ‎每一个住院的人
And remember, for every one of these, for every hospital admission,
‎背后都有一个受伤的、惊恐的家庭
there's a family that is traumatized and horrified.
‎“天啊 我的孩子们怎么了？”
"My God, what is happening to our kids?"
[Isla sighs]
‎在我看来 问题很显而易见
[Tim] It's plain as day to me.
‎这些服务正在杀人 ‎也在导致人们自杀
These services are killing people... and causing people to kill themselves.
‎我不认识哪个家长会说 ‎“是 我希望我的孩子们 成长过程中
I don't know any parent who says, "Yeah, I really want my kids to be growing up
‎感觉被技术设计师操控
feeling manipulated by tech designers, uh,
‎操控他们的注意力 ‎让他们无法完成作业
manipulating their attention, making it impossible to do their homework,
‎让他们将自己 ‎和不切实际的审美标准相对比”
making them compare themselves to unrealistic standards of beauty."
‎没有人希望那样
Like, no one wants that. [chuckles]
‎没有一个人
No one does.
‎我们以前有一些保护措施
We... We used to have these protections.
‎小孩子们观看周六早间动画片的时候
When children watched Saturday morning cartoons,
‎我们关心保护儿童
we cared about protecting children.
‎我们会说：“你不能这样 ‎给这个年龄段的孩子看广告”
We would say, "You can't advertise to these age children in these ways."
‎然后有了YouTube儿童频道
But then you take YouTube for Kids,
‎蚕食了注意力经济的全部
and it gobbles up that entire portion of the attention economy,
‎现在所有的孩子 ‎都能看YouTube儿童频道
and now all kids are exposed to YouTube for Kids.
‎所有的保护措施 ‎所有的管理规定都不见了
And all those protections and all those regulations are gone.
[tense instrumental music playing]
‎（没有手机的时间）
‎我们在训练、调节整个一代人…
[Tristan] We're training and conditioning a whole new generation of people...
‎我们不自在、孤独、不确定或害怕时
that when we are uncomfortable or lonely or uncertain or afraid,
‎有一个自己的数码安慰
we have a digital pacifier for ourselves
‎这有点让我们 ‎自己处理这些情绪的能力退化了
that is kind of atrophying our own ability to deal with that.
[Tristan] Photoshop didn't have 1,000 engineers
‎Photoshop屏幕的另一端 ‎没有几千个工程师
on the other side of the screen, using notifications, using your friends,
‎用通知 用你的朋友
‎用人工智能去预判 ‎什么能完美地让你上瘾 引诱你
using AI to predict what's gonna perfectly addict you, or hook you,
‎或者操纵你 或者允许广告商
or manipulate you, or allow advertisers
‎去测试六万种不同的文本或颜色
to test 60,000 variations of text or colors to figure out
‎（芝加哥反垄断技术会议）
‎…以此来找到 ‎怎样能完美地操纵你的思想
what's the perfect manipulation of your mind.
‎这是一种全新的力量和影响
This is a totally new species of power and influence.
‎我想再一次强调 他们使用的
I... I would say, again, the methods used
‎玩弄人们的能力 ‎让人们成瘾或者受到影响
to play on people's ability to be addicted or to be influenced
may be different this time, and they probably are different.
‎或许这一次是不同的 ‎或许他们是不同的
‎报纸问世时 印刷媒体问世时 ‎与现在很不同
They were different when newspapers came in and the printing press came in,
‎电视问世的时候 与现在很不同
and they were different when television came in,
‎当时有三个主要的…
and you had three major networks and...
‎-网络 ‎-当时 我也想说
-At the time. -At the time. That's what I'm saying.
‎但我在说 这是一个全新的层次
But I'm saying the idea that there's a new level
‎这个新的层次 以前也发生过很多次
and that new level has happened so many times before.
‎这只是我们看见的 最新的一个层次
I mean, this is just the latest new level that we've seen.
‎有这样一种说法：“我们去适应它
There's this narrative that, you know, "We'll just adapt to it.
‎我们要学着与这些设备共存
We'll learn how to live with these devices,
‎就像我们学着 ‎和其他所有事物共存一样”
just like we've learned how to live with everything else."
‎但这个说法没有注意到的是 ‎有些东西明显是全新的
And what this misses is there's something distinctly new here.
Perhaps the most dangerous piece of all this is the fact
‎或许这其中最危险的是
that it's driven by technology that's advancing exponentially.
‎这是由技术驱动的 ‎在成指数地向前发展
‎（计算机处理能力）
Roughly, if you say from, like, the 1960s to today,
‎大体上 ‎如果你看从20世纪60年代至今
‎计算机处理能力增长了万亿倍
processing power has gone up about a trillion times.
‎我们身边没有任何其他东西 ‎以这个速率增长
Nothing else that we have has improved at anything near that rate.
‎比如 汽车速度基本上才实现翻倍
Like, cars are, you know, roughly twice as fast.
‎几乎所有其他的东西都显得微不足道
And almost everything else is negligible.
‎或许最重要的是
And perhaps most importantly,
‎我们人类… 我们的生理 ‎我们的大脑 根本没有丝毫进化
our human-- our physiology, our brains have evolved not at all.
‎（没有手机的时间）
‎人类的思想、身体和体质
[Tristan] Human beings, at a mind and body and sort of physical level,
‎基本上不会改变了
are not gonna fundamentally change.
[indistinct chatter]
[chuckling] I know, but they...
[continues speaking indistinctly]
[camera shutter clicks]
‎我们可以搞基因工程 ‎在未来开发新的人类物种
[Tristan] We can do genetic engineering and develop new kinds of human beings,
‎但是现实来讲 ‎你生活在大脑这个硬件下
but realistically speaking, you're living inside of hardware, a brain,
‎已经存在几百万年了
that was, like, millions of years old,
‎然后出现了这样一个屏幕 ‎在屏幕的另一端
and then there's this screen, and then on the opposite side of the screen,
‎有上千名工程师和超级计算机
there's these thousands of engineers and supercomputers
‎有着与你不同的目标
that have goals that are different than your goals,
‎那么 这个游戏谁能赢呢？谁会赢？
and so, who's gonna win in that game? Who's gonna win?
‎我们怎么会输？
How are we losing?
‎-我不知道 ‎-他在哪里？这太不正常了
-I don't know. -Where is he? This is not normal.
‎我给他推送朋友和家人的内容太多 ‎他烦了吗？
Did I overwhelm him with friends and family content?
‎-或许吧 ‎-或许是广告太多了
-Probably. -Well, maybe it was all the ads.
‎不 一定出了严重的问题 ‎我们切换到复苏模式吧
No. Something's very wrong. Let's switch to resurrection mode.
‎当你想到人工智能 ‎人工智能会毁掉世界
[Tristan] When you think of AI, you know, an AI's gonna ruin the world,
‎你会看到《终结者》 看到施瓦辛格…
and you see, like, a Terminator, and you see Arnold Schwarzenegger.
‎我会回来的
I'll be back.
‎…你会看到无人机 你觉得 ‎“人工智能会杀人的”
[Tristan] You see drones, and you think, like,
"Oh, we're gonna kill people with AI."
‎人们忽略的是 人工智能 ‎现在已经在运营着当今世界了
And what people miss is that AI already runs today's world right now.
‎甚至谈论“人工智能”都只是暗喻
Even talking about "an AI" is just a metaphor.
‎在谷歌这种公司 有超级大的房间
At these companies like... like Google, there's just massive, massive rooms,
‎有些在地下 有些在水下
some of them underground, some of them underwater,
‎房间里全是电脑
of just computers.
‎无数的电脑 连绵不绝
Tons and tons of computers, as far as the eye can see.
‎它们互相之间在内部深度连接
They're deeply interconnected with each other
‎在运行着极其复杂的程序
and running extremely complicated programs,
‎始终不停地在彼此之间交换信息
sending information back and forth between each other all the time.
‎他们会运行很多不同的程序
And they'll be running many different programs,
‎在同样的机器上 有不同的产品
many different products on those same machines.
‎有些东西可以被描述为简单算法
Some of those things could be described as simple algorithms,
‎有些算法太过复杂
some could be described as algorithms
‎就可以被称为“智能”
that are so complicated, you would call them intelligence.
[crew member sighs]
[Cathy] I like to say that algorithms are opinions
‎我想说 算法是内嵌在代码中的观点…
embedded in code...
‎算法并不是客观的
and that algorithms are not objective.
‎算法被某种成功的定义优化
Algorithms are optimized to some definition of success.
‎所以 如果你能想象
So, if you can imagine,
‎一个商业公司成功的定义
if a... if a commercial enterprise builds an algorithm
‎需要依靠算法
to their definition of success,
‎那就是商业利益
it's a commercial interest.
‎通常都有利润
It's usually profit.
‎你给电脑一个目标 ‎说“我想要这个结果”
You are giving the computer the goal state, "I want this outcome,"
‎电脑自己去学习 怎样实现
and then the computer itself is learning how to do it.
‎这是“机器学习”概念的由来
That's where the term "machine learning" comes from.
‎所以 每一天 都会更好一点
And so, every day, it gets slightly better
‎在正确命令获取正确的推送数据
at picking the right posts in the right order
‎让你在这个产品上花的时间越来越多
so that you spend longer and longer in that product.
‎没人能真正明白 为了实现这个目标
And no one really understands what they're doing
‎他们在做什么
in order to achieve that goal.
‎算法有着自己的思想 虽然是人写的
The algorithm has a mind of its own, so even though a person writes it,
‎它写出来的目的
it's written in a way
‎是你建立一个机器 ‎这个机器会自己改变
that you kind of build the machine, and then the machine changes itself.
‎这种公司 员工非常少
There's only a handful of people at these companies,
‎在脸书、推特和其他公司
at Facebook and Twitter and other companies...
‎只有几个人能明白 ‎这些系统的工作原理
There's only a few people who understand how those systems work,
‎虽然他们不需要完全理解
and even they don't necessarily fully understand
‎某一条特定的内容 会发生什么
what's gonna happen with a particular piece of content.
‎作为人类 我们几乎 ‎已经失去了对这些系统的控制
So, as humans, we've almost lost control over these systems.
‎因为是它们在控制我们看到的信息
Because they're controlling, you know, the information that we see,
‎更多的是它们在控制我们 ‎而不是我们控制它们
they're controlling us more than we're controlling them.
-[console whirs] -[Growth AI] Cross-referencing him
‎在他的地理区域对他和可以对比的人 ‎进行交叉参照
against comparables in his geographic zone.
‎他的心理测定相似者
His psychometric doppelgangers.
‎在他的地区 ‎有13694个和他行为相似的人
There are 13,694 people behaving just like him in his region.
‎-他们中盛行什么？ ‎-我们需要真实的好东西
-What's trending with them? -We need something actually good
‎才能进行有效的复苏
for a proper resurrection,
‎因为平常的那些东西已经不起作用了
given that the typical stuff isn't working.
‎学校那个可爱的姑娘都没用了
Not even that cute girl from school.
‎我的分析显示 ‎用极端中心内容搞政治
My analysis shows that going political with Extreme Center content
‎有62.3%的几率能够获得长期参与
has a 62.3 percent chance of long-term engagement.
‎还不错
That's not bad.
[sighs] It's not good enough to lead with.
‎想用它引导 还不太够
Okay, okay, so we've tried notifying him about tagged photos,
‎好 所以我们已经试过 ‎通知给他圈人照片
‎邀请、实事、甚至是瑞贝卡的私信
invitations, current events, even a direct message from Rebecca.
‎但是用户01265923010呢？
But what about User 01265923010?
‎是 本点赞了她所有的发帖
Yeah, Ben loved all of her posts.
‎几个月的所有发帖 真的点了所有 ‎然后就没有然后了
For months and, like, literally all of them, and then nothing.
‎我算出了通知安娜的内容
I calculate a 92.3 percent chance of resurrection
‎会有92.3%的复苏概率
with a notification about Ana.
‎（新感情）
‎还有她的新朋友
And her new friend.
‎（没有手机的时间）
[eerie instrumental music playing]
[cell phone vibrates]
‎（你的前女友有了新感情！）
[Ben] Oh, you gotta be kiddin' me.
‎不是吧
Uh... [sighs]
‎好吧
Okay.
‎（安娜与路易斯正在热恋）
‎什么？
-What? -[fanfare plays, fireworks pop]
[claps] Bam! We're back!
‎当！我们回来了！
‎我们继续挣钱 兄弟们
Let's get back to making money, boys.
‎好 让他们和整个世界联系起来
Yes, and connecting Ben with the entire world.
‎我给他看所有他可能喜欢的信息
I'm giving him access to all the information he might like.
‎你们是否想过 ‎这些推送对本是好的吗？
Hey, do you guys ever wonder if, you know, like, the feed is good for Ben?
-No. -No. [chuckles slightly]
‎-没想过 ‎-没有
-[chuckles softly] -["I Put a Spell on You" playing]
♪ I put a spell on you ♪
‎我在你身上下了咒语
‎因为你是我的
♪ 'Cause you're mine ♪
[vocalizing] ♪ Ah! ♪
‎你最好停止你做的事情
♪ You better stop the things you do ♪
‎我不骗你
♪ I ain't lyin' ♪
‎（A/B测试 极端中心）
‎不 我不骗你
♪ No, I ain't lyin' ♪
‎你知道我无法忍受
♪ You know I can't stand it ♪
‎你在四处奔跑
♪ You're runnin' around ♪
‎爸爸 你更清楚
♪ You know better, Daddy ♪
‎我无法忍受 因为你将我放下
♪ I can't stand it 'Cause you put me down ♪
‎耶
♪ Yeah, yeah ♪
‎我在你身上下了咒语
♪ I put a spell on you ♪
‎因为你是我的
♪ Because you're mine ♪
‎你是我的
♪ You're mine ♪
‎想象一下 你在用脸书…
[Roger] So, imagine you're on Facebook...
‎你的对手是人工智能
and you're effectively playing against this artificial intelligence
‎它知道你的一切
that knows everything about you,
‎能够预测你未来的举动 ‎你对它却一无所知
can anticipate your next move, and you know literally nothing about it,
‎除了上面有猫的视频和出生日期
except that there are cat videos and birthdays on it.
‎这根本不是公平的竞争
That's not a fair fight.
‎本与杰瑞 该走了 孩子？
Ben and Jerry, it's time to go, bud!
[sighs]
‎本？
Ben?
[knocks lightly on door]
‎本
-[Cass] Ben. -[Ben] Mm.
‎快点
Come on.
‎该上学了 我们走
School time. [claps]
Let's go.
[Ben sighs]
‎（人道技术中心）
[excited chatter]
‎-你今天怎么样？ ‎-我很紧张
-[tech] How you doing today? -Oh, I'm... I'm nervous.
‎-你紧张吗？ ‎-是啊
-Are ya? -Yeah. [chuckles]
‎我们都在当心这个时刻
[Tristan] We were all looking for the moment
‎当技术会超越人类力量和智慧
when technology would overwhelm human strengths and intelligence.
‎技术什么时候会超越人类 ‎取代我们的工作 比人类更聪明？
When is it gonna cross the singularity, replace our jobs, be smarter than humans?
‎但有更早的时刻…
But there's this much earlier moment...
‎技术超越人类的弱点时
when technology exceeds and overwhelms human weaknesses.
‎这个超越的点就是上瘾
This point being crossed is at the root of addiction,
‎两极分化、激进化、激化愤怒
polarization, radicalization, outrage-ification,
‎激化虚荣 一切的根源
vanity-ification, the entire thing.
‎它在压制人类天性
This is overpowering human nature,
‎在挫伤人性
and this is checkmate on humanity.
-[sighs deeply] -[door opens]
‎很抱歉
I'm sorry. [sighs]
-[seat belt clicks] -[engine starts]
‎我努力让人们明白
[Jaron] One of the ways I try to get people to understand
‎脸书这种地方的推送 ‎有多错误的一种方式
just how wrong feeds from places like Facebook are
‎是让他们去想想维基百科
is to think about the Wikipedia.
‎（新标签页）
‎当你打开一个维基百科网页 ‎你和别人看到的东西是一样的
When you go to a page, you're seeing the same thing as other people.
‎（维基百科 自由的百科全书）
So, it's one of the few things online that we at least hold in common.
‎所以 这是网络上少有的 ‎我们统一共享的东西
‎现在 现象一下 维基百科说
Now, just imagine for a second that Wikipedia said,
‎我们要给每一个人不同的个性化定义
"We're gonna give each person a different customized definition,
‎有人给我们钱 让我们这样做”
and we're gonna be paid by people for that."
‎维基百科就会监视你 会计算
So, Wikipedia would be spying on you. Wikipedia would calculate,
‎“我要做什么 才能代表一些商业利益
"What's the thing I can do to get this person to change a little bit
‎让这个人产生一点改变？” 对吧？
on behalf of some commercial interest?" Right?
‎然后就会改变整个词条
And then it would change the entry.
‎你能想象吗？
Can you imagine that? Well, you should be able to,
‎你应该能够想象得到
‎因为在脸书页面上 就是这样的
'cause that's exactly what's happening on Facebook.
‎你的YouTube推送 就是这样的
It's exactly what's happening in your YouTube feed.
‎当你登录谷歌 输入“气候变化是…”
When you go to Google and type in "Climate change is,"
‎你会看到 根据你所居住的地区不同 ‎会出现不同的结果
you're going to see different results depending on where you live.
‎（气候变化是）
‎在某些城市 你会看到自动完成…
In certain cities, you're gonna see it autocomplete
‎“气候变化是一场骗局”
with "climate change is a hoax."
‎在其他地方 你将会看到
In other cases, you're gonna see
‎“气候变化是对自然的破坏”
"climate change is causing the destruction of nature."
‎这个功能 ‎提供的不都是气候变化的真相
And that's a function not of what the truth is about climate change,
‎而是你在哪里进行谷歌搜索
but about where you happen to be Googling from
‎以及谷歌对你个人兴趣的了解
and the particular things Google knows about your interests.
Even two friends who are so close to each other,
‎即便是两个非常亲近的朋友
‎他们两个有着完全相同的朋友圈子
who have almost the exact same set of friends,
‎他们会认为 ‎“我们会看到脸书上的新推送
they think, you know, "I'm going to news feeds on Facebook.
‎会看到完全相同的更新” ‎但事实远非如此
I'll see the exact same set of updates."
But it's not like that at all.
‎他们会看到完全不同的世界
They see completely different worlds
‎因为这些是基于计算机的计算
because they're based on these computers calculating
‎对每一个人来说 怎样最完美
what's perfect for each of them.
‎（直播中）
[whistling over monitor]
‎想象这件事的一个方式是 ‎这是27亿人的《楚门的世界》
[Roger] The way to think about it is it's 2.7 billion Truman Shows.
‎每一个人都有自己的现实 自己的…
Each person has their own reality, with their own...
‎事实
facts.
‎你觉得楚门为什么到现在都 ‎从来没有接近
Why do you think that, uh, Truman has never come close
‎发现他所在世界的真实本质？
to discovering the true nature of his world until now?
‎我们接受了 ‎呈现在我们面前的世界就是现实
We accept the reality of the world with which we're presented.
‎就是这么简单
It's as simple as that.
‎（直播中）
‎随着时间推移 你会有一种错觉 ‎觉得每一个人都认同你
Over time, you have the false sense that everyone agrees with you,
‎因为给你推送的新闻中 ‎每个人都和你极其相似
because everyone in your news feed sounds just like you.
‎一旦你达到了这种状态 ‎你就很容易被操纵了
And that once you're in that state, it turns out you're easily manipulated,
‎和你被魔术师操纵 是同样的方式
the same way you would be manipulated by a magician.
‎魔术师给你看纸牌魔术 跟你说 ‎“选一张牌 哪张都行”
A magician shows you a card trick and says, "Pick a card, any card."
‎你没有意识到的是 ‎他们早就给你设好陷阱了
What you don't realize was that they've done a set-up,
‎于是你选的那张牌 ‎是他们想让你选的
so you pick the card they want you to pick.
‎这就是脸书的工作原理 ‎脸书坐在那里说
And that's how Facebook works. Facebook sits there and says,
‎“喂 选择你的朋友 ‎选择你关注的联系人”
"Hey, you pick your friends. You pick the links that you follow."
‎根本是胡扯 它就跟魔术师一样
But that's all nonsense. It's just like the magician.
‎脸书负责给你进行新闻推送
Facebook is in charge of your news feed.
‎我们都不过是 ‎在基于不同的一系列事实行事
We all simply are operating on a different set of facts.
‎当大范围发生时
When that happens at scale,
‎你就再也无法考虑甚至消化
you're no longer able to reckon with or even consume information
that contradicts with that world view that you've created.
‎与你所创造的世界观相悖的信息了
‎那就意味着 ‎我们其实不是客观、有建设性的个体
That means we aren't actually being objective,
constructive individuals. [chuckles]
[crowd chanting] Open up your eyes, don't believe the lies! Open up...
‎睁大你的眼睛 别相信谎言！睁大…
‎然后你扫了一眼另一边
[Justin] And then you look over at the other side,
‎你开始想 ‎“这些人怎么会如此愚蠢？”
and you start to think, "How can those people be so stupid?
‎他们也看到了我不停看到的这些信息
Look at all of this information that I'm constantly seeing.
‎他们怎么会看不到相同的信息？
How are they not seeing that same information?"
‎问题的答案是 ‎“他们没有看到相同的信息”
And the answer is, "They're not seeing that same information."
‎睁大你的眼睛 别相信谎言！
[crowd continues chanting] Open up your eyes, don't believe the lies!
[shouting indistinctly]
‎共和党人什么样？
-[interviewer] What are Republicans like? -People that don't have a clue.
‎愚昧无知
‎民主党就是一个犯罪团伙 ‎不是真正的政治党派
The Democrat Party is a crime syndicate, not a real political party.
‎皮尤研究中心一项全新的大型研究 ‎对一万名美国成年人进行调查
A huge new Pew Research Center study of 10,000 American adults
‎发现我们比任何时候都要分裂
finds us more divided than ever,
‎个人和政治两极分化达到20年来最高
with personal and political polarization at a 20-year high.
[pundit] You have more than a third of Republicans saying
‎有超过三分之一的共和党人说
‎民主党是对这个国家的威胁
the Democratic Party is a threat to the nation,
‎民主党超过四分之一的人 ‎也这样说共和党
more than a quarter of Democrats saying the same thing about the Republicans.
‎我们讨论的很多问题
So many of the problems that we're discussing,
‎比如政治两极分化
like, around political polarization
‎在有线电视上大量存在
exist in spades on cable television.
‎媒体也有着同样的问题
The media has this exact same problem,
‎整体上来说 他们的商业模式
where their business model, by and large,
‎是把我们的关注出售给广告商
is that they're selling our attention to advertisers.
‎网络只是一个新的、更有效率的 ‎实现方式罢了
And the Internet is just a new, even more efficient way to do that.
[Guillaume] At YouTube, I was working on YouTube recommendations.
‎我曾在YouTube的工作 ‎是研究YouTube推荐
‎让我担心的是 我研究的一个算法
It worries me that an algorithm that I worked on
‎增加了社会中的两极分化
is actually increasing polarization in society.
‎但从观看时间来看
But from the point of view of watch time,
‎这种两极分化 ‎在让人们持续在线观看上 极其有效
this polarization is extremely efficient at keeping people online.
‎这些老师教这些东西的唯一原因
The only reason these teachers are teaching this stuff
‎是有人给他们钱 让他们教
is 'cause they're getting paid to.
‎-太扯了 ‎-喂 本杰
-It's absolutely absurd. -[Cass] Hey, Benji.
‎今天没有足球训练吗？
No soccer practice today?
‎有 我只想看看今天的新闻
Oh, there is. I'm just catching up on some news stuff.
[vlogger] Do research. Anything that sways from the Extreme Center--
‎你去研究一下 极端中心说的任何话…
‎都不会把你看的这个东西称作新闻
Wouldn't exactly call the stuff that you're watching news.
‎你总是说一切都那么混乱 确实是
You're always talking about how messed up everything is. So are they.
‎但那东西只是政治鼓吹
But that stuff is just propaganda.
‎没有一个是真的 ‎全都是让你觉得合理
[vlogger] Neither is true. It's all about what makes sense.
‎本 我很严肃 这些东西对你有害
Ben, I'm serious. That stuff is bad for you.
‎你应该去足球训练
-You should go to soccer practice. -[Ben] Mm.
[Cass sighs]
‎我分享这个东西 是因为我在意
I share this stuff because I care.
‎我在意你被误导 这是不对的 好吗？
I care that you are being misled, and it's not okay. All right?
‎人们认为算法的设计
[Guillaume] People think the algorithm is designed
‎是给他们真正想要的 但其实不然
to give them what they really want, only it's not.
‎算法其实是在试图 ‎找到几个非常强大的兔子洞
The algorithm is actually trying to find a few rabbit holes that are very powerful,
‎试图找到哪一个兔子洞 ‎最贴近你的兴趣
trying to find which rabbit hole is the closest to your interest.
‎然后 如果你开始观看其中一个视频
And then if you start watching one of those videos,
‎它就会不停继续推荐
then it will recommend it over and over again.
‎这种情况 并不是有人刻意为之
It's not like anybody wants this to happen.
‎只是推荐系统一直在做而已
It's just that this is what the recommendation system is doing.
‎以至于著名篮球运动员凯里·欧文
So much so that Kyrie Irving, the famous basketball player,
uh, said he believed the Earth was flat, and he apologized later
‎说他相信地球是平的 后来又道歉
‎因为他把责任推给 ‎YouTube的一个兔子洞
because he blamed it on a YouTube rabbit hole.
‎你点击 YouTube视频
You know, like, you click the YouTube click
‎它会继续 这个兔子洞能有多深
and it goes, like, how deep the rabbit hole goes.
‎他后来在国家公共广播电台上说
When he later came on to NPR to say,
‎“很抱歉我相信了这个 ‎我无意误导人们”
"I'm sorry for believing this. I didn't want to mislead people,"
‎有人采访了教室中的一群学生 ‎他们说
a bunch of students in a classroom were interviewed saying,
‎“相信地球是圆的人肯定找他谈了”
"The round-Earthers got to him."
[audience chuckles]
‎地球平面阴谋论被算法
The flat-Earth conspiracy theory was recommended
‎推荐了几亿次
hundreds of millions of times by the algorithm.
‎很容易去想 ‎只有几个愚蠢的人被说服罢了
It's easy to think that it's just a few stupid people who get convinced,
‎但是算法每一天都在变得更聪明
but the algorithm is getting smarter and smarter every day.
‎今天 它们说服人们相信 地球是平的
So, today, they are convincing the people that the Earth is flat,
‎但是明天 它们就会说服你相信 ‎一个完全虚假的事情
but tomorrow, they will be convincing you of something that's false.
‎11月7日 话题标签‘披萨门’诞生了
[reporter] On November 7th, the hashtag "Pizzagate" was born.
‎披萨门…
[Renée] Pizzagate...
[clicks tongue] Oh, boy.
‎天啊
Uh... [laughs]
‎我还是不能百分之百确定 ‎这个最初是从哪里来的
I still am not 100 percent sure how this originally came about,
‎但是订披萨等于订一个贩卖的人口 ‎这个想法
but the idea that ordering a pizza meant ordering a trafficked person.
‎由于脸书上的多个小组越来越大
As the groups got bigger on Facebook,
‎脸书推荐引擎开始建议普通用户
Facebook's recommendation engine started suggesting to regular users
‎让他们加入披萨门小组
that they join Pizzagate groups.
‎所以 如果一个用户反对疫苗 ‎或者相信飞机喷洒重金属阴谋论
So, if a user was, for example, anti-vaccine or believed in chemtrails
‎或者对脸书的算法表示过
or had indicated to Facebook's algorithms in some way
‎他们易于相信阴谋论
that they were prone to belief in conspiracy theories,
‎脸熟的推荐引擎 ‎就会推荐给他们披萨门小组
Facebook's recommendation engine would serve them Pizzagate groups.
‎最终 这件事达到高潮 ‎一名男子携枪出现
Eventually, this culminated in a man showing up with a gun,
‎决定他要给披萨店地下室的 ‎那些孩子们自由
deciding that he was gonna go liberate the children from the basement
‎而这个披萨店根本没有地下室
of the pizza place that did not have a basement.
[officer 1] What were you doing?
‎-你当时在这个地方做什么？ ‎-确保这里什么都没有
[man] Making sure there was nothing there.
‎-什么事？ ‎-恋童癖怪圈
-[officer 1] Regarding? -[man] Pedophile ring.
‎-什么事？ ‎-恋童癖怪圈
-[officer 1] What? -[man] Pedophile ring.
‎披萨门 他在说披萨门
[officer 2] He's talking about Pizzagate.
‎这是阴谋论在所有社交媒体上
This is an example of a conspiracy theory
‎到处传播的一个例子
that was propagated across all social networks.
‎社交网络自己的推荐引擎
The social network's own recommendation engine
‎自愿把这个东西推送给
is voluntarily serving this up to people
‎这辈子从来没有搜索过 ‎“披萨门”的人们
who had never searched for the term "Pizzagate" in their life.
‎（披萨门 ‎民主党和恋童癖的深盘披萨）
[Tristan] There's a study, an MIT study,
‎有一个研究 麻省理工的研究
‎说推特上传播的虚假新闻 ‎比真实新闻传播速度快六倍
that fake news on Twitter spreads six times faster than true news.
‎当一个人有着高于另一个人
What is that world gonna look like
‎六倍的优势 这种世界会是什么样？
when one has a six-times advantage to the other one?
‎你可以想象 这些事情有点…
You can imagine these things are sort of like...
‎将人类行为的基础平面倾斜了
they... they tilt the floor of... of human behavior.
‎让一些行为更难 让一些行为更容易
They make some behavior harder and some easier.
‎你总是可以自由地走上山坡
And you're always free to walk up the hill,
‎但是这样做的人越来越少
but fewer people do,
‎所以大范围内 在整个社会范围内 ‎你就是将基础平面倾斜了
and so, at scale, at society's scale, you really are just tilting the floor
‎改变了数十亿人的想法和行为
and changing what billions of people think and do.
‎我们创造了一个 ‎偏心于虚假消息的体系
We've created a system that biases towards false information.
‎并不是因为我们想这样做
Not because we want to,
‎而是因为虚假信息比真实信息 ‎能让各个公司
but because false information makes the companies more money
‎赚到更多钱 真实信息比较无聊
than the truth. The truth is boring.
‎这是一个 ‎利用虚假信息牟利的商业模式
It's a disinformation-for-profit business model.
‎允许未受监管的信息传送给更多的人
You make money the more you allow unregulated messages
‎卖出最好的价钱 以此来赚钱
to reach anyone for the best price.
‎因为气候变化？对
Because climate change? Yeah.
‎这是骗局 对 是真的 这才是重点
It's a hoax. Yeah, it's real. That's the point.
‎他们谈论这件事情越多 ‎就越会将我们分化
The more they talk about it and the more they divide us,
‎他们越有力量 就越有控制权
the more they have the power, the more...
‎脸书有万亿个新闻推送贴
[Tristan] Facebook has trillions of these news feed posts.
‎他们无法知道哪些是真的 ‎哪些是事实…
They can't know what's real or what's true...
‎所以当下这个议题 才如此重要
which is why this conversation is so critical right now.
‎传播迅速的 不只是新冠病毒
[reporter 1] It's not just COVID-19 that's spreading fast.
‎网上有关于这个病毒的大量虚假信息
There's a flow of misinformation online about the virus.
‎多喝水能将新冠病毒 ‎从你身体中冲走的提议
[reporter 2] The notion drinking water
will flush coronavirus from your system
‎是在社交媒体上广泛流传的 ‎该病毒的谜题之一
is one of several myths about the virus circulating on social media.
‎这是政府计划的事件 ‎创造了这个病毒
[automated voice] The government planned this event, created the virus,
‎来模拟世界各国将会如何应对
and had a simulation of how the countries would react.
‎新冠病毒是一场骗局
Coronavirus is a... a hoax.
‎非典 新冠病毒
[man] SARS, coronavirus.
‎看看这是什么时候制造的 2018年
And look at when it was made. 2018.
‎我觉得是美国政府开始的这场闹剧
I think the US government started this shit.
‎根本没有人生病 没人生病
Nobody is sick. Nobody is sick. Nobody knows anybody who's sick.
‎没有人认识哪个人真正生病了
‎或许是政府在利用新冠病毒当借口
Maybe the government is using the coronavirus as an excuse
‎让所有人留在家 ‎因为有其他的事情要发生
to get everyone to stay inside because something else is happening.
‎新冠病毒不会杀人
Coronavirus is not killing people,
‎他们是在掩盖5G辐射害死的人
it's the 5G radiation that they're pumping out.
‎（5G信号塔被割倒焚烧）
[crowd shouting]
‎我们被谣言轰炸
[Tristan] We're being bombarded with rumors.
‎人们去毁掉了真实的手机信号塔
People are blowing up actual physical cell phone towers.
‎我们看到俄罗斯和中国 ‎传播谣言和阴谋论
We see Russia and China spreading rumors and conspiracy theories.
‎今天早上 乌克兰的恐慌与抗议…
[reporter 3] This morning, panic and protest in Ukraine as...
‎人们不知道什么是真相 ‎现在已经闹出人命了
[Tristan] People have no idea what's true, and now it's a matter of life and death.
[woman] Those sources that are spreading coronavirus misinformation
‎那些传播新冠病毒虚假信息的来源
‎积累了5200万人参与
have amassed something like 52 million engagements.
‎你是说 胶银溶液会有效
You're saying that silver solution would be effective.
‎我们这样说吧 ‎虽然没有用新冠病毒的毒株测试过
Well, let's say it hasn't been tested on this strain of the coronavirus, but...
‎我们看到的新冠病毒 ‎只是发生在我们信息生态系统中的
[Tristan] What we're seeing with COVID is just an extreme version
‎一个极端案例
of what's happening across our information ecosystem.
‎（惠特默 希特勒）
Social media amplifies exponential gossip and exponential hearsay
‎社交媒体放大了增长迅速的谣言 ‎和增长迅速的道听途说
‎以至于我们都不知道 什么是真了
to the point that we don't know what's true,
‎不管我们关注的是什么问题
no matter what issue we care about.
[teacher] He discovers this.
[continues lecturing indistinctly]
[Rebecca whispers] Ben.
‎你还在队里吗？
-Are you still on the team? -[Ben] Mm-hmm.
[Rebecca] Okay, well, I'm gonna get a snack before practice
‎好 如果你想来 我在训练之前 ‎先去吃点零食 你要来吗？
if you... wanna come.
[Ben] Hm?
[Rebecca] You know, never mind.
‎当我没说
[footsteps fading]
‎当前 十个人当中 有九个人不满意
[vlogger] Nine out of ten people are dissatisfied right now.
‎你仔细想想 极端中心和历史上 ‎任何政治运动无异
The EC is like any political movement in history, when you think about it.
‎我们要站起来反抗 ‎我们要站起来反抗这种杂音
We are standing up, and we are... we are standing up to this noise.
‎你是我的人民 我相信你们
You are my people. I trust you guys.
‎-极端中心的内容好棒 ‎-他非常喜欢
-The Extreme Center content is brilliant. -He absolutely loves it.
‎运行一个拍卖
Running an auction.
‎843个竞标人 他以4.35美分 ‎卖给了一个武器生产商
840 bidders. He sold for 4.35 cents to a weapons manufacturer.
‎我们来宣传一下这些活动
Let's promote some of these events.
‎这星期晚些时候 ‎将在这片地理区域发生的群众集会
Upcoming rallies in his geographic zone later this week.
‎新的视频博主也安排好了
I've got a new vlogger lined up, too.
[chuckles]
And... and, honestly, I'm telling you, I'm willing to do whatever it takes.
‎说实话 我告诉你 ‎我愿意付出任何代价
‎我说 任何代价
And I mean whatever.
‎-订阅… ‎-本？
-Subscribe... -[Cass] Ben?
‎…记得回来 因为我告诉你们…
...and also come back because I'm telling you, yo...
-[knocking on door] -...I got some real big things comin'.
‎我后面会有大事件
‎非常大的事件
Some real big things.
‎脸书的一个问题是 ‎作为一个有劝说性质的工具
[Roger] One of the problems with Facebook is that, as a tool of persuasion,
‎它或许是史上最伟大的发明
it may be the greatest thing ever created.
‎现在 你来想象一下 落在独裁者 ‎或者集权主义者手中 会怎样
Now, imagine what that means in the hands of a dictator or an authoritarian.
‎如果你想控制你们国家的人民
If you want to control the population of your country,
‎从未有过像脸书这样有效的工具
there has never been a tool as effective as Facebook.
‎一个问题最大的影响是
[Cynthia] Some of the most troubling implications
‎一些政府和其他不良人士 ‎把社交媒体当作武器
of governments and other bad actors weaponizing social media,
um, is that it has led to real, offline harm.
‎导致了真实的线下伤害
‎我认为最明显的案例
I think the most prominent example
‎广泛被媒体关注的 ‎是缅甸发生的事情
that's gotten a lot of press is what's happened in Myanmar.
‎（缅甸总统办公室）
‎在缅甸 人们想到网络时
In Myanmar, when people think of the Internet,
‎他们想到的 是脸书
what they are thinking about is Facebook.
‎经常发生的事情是 人们买了手机
And what often happens is when people buy their cell phone,
‎手机店主会提前帮他们下载好脸书
the cell phone shop owner will actually preload Facebook on there for them
‎帮他们开好账户
and open an account for them.
‎于是人们拿到手机之后 ‎第一个打开的应用
And so when people get their phone, the first thing they open
‎他们唯一知道怎样打开的 就是脸书
and the only thing they know how to open is Facebook.
‎一个新的震惊调查显示 ‎脸书日益增长的
Well, a new bombshell investigation exposes Facebook's growing struggle
‎对抗缅甸仇恨言论的难题
to tackle hate speech in Myanmar.
‎（停止杀害穆斯林）
[crowd shouting]
‎脸书真的给军人和其他不良人士
Facebook really gave the military and other bad actors
‎一种控制公众言论的新手段
a new way to manipulate public opinion
‎并协助煽动 ‎针对罗兴亚族穆斯林的暴力
and to help incite violence against the Rohingya Muslims
‎包括大屠杀
that included mass killings,
‎焚烧整个村庄
burning of entire villages,
‎违反人道主义的 ‎大规模强奸和其他严重犯罪行为
mass rape, and other serious crimes against humanity
‎已经导致七十万罗兴亚族穆斯林 ‎逃出这个国家
that have now led
to 700,000 Rohingya Muslims having to flee the country.
‎这种情绪高涨的鼓吹 ‎以前并不是没有出现过
It's not that highly motivated propagandists
haven't existed before.
‎只是这个平台实现了
It's that the platforms make it possible
‎让操纵性言论传播变得异常容易
to spread manipulative narratives with phenomenal ease,
‎也不用花多少钱
and without very much money.
‎如果我想操纵竞选
If I want to manipulate an election,
‎我现在可以去脸书上的 ‎一个阴谋论小组
I can now go into a conspiracy theory group on Facebook,
‎可以找到一百个人
and I can find 100 people
‎他们深信地球是平的
who believe that the Earth is completely flat
‎认为我们登月 完全是阴谋论
and think it's all this conspiracy theory that we landed on the moon,
‎我可以告诉脸书 ‎“给我推荐一千个这种用户”
and I can tell Facebook, "Give me 1,000 users who look like that."
‎脸书会非常开心地发给我 ‎几千个这种用户
Facebook will happily send me thousands of users that look like them
‎我现在可以给他们讲更多的阴谋论
that I can now hit with more conspiracy theories.
-[button clicks] -Sold for 3.4 cents an impression.
‎以3.4美分卖了一个印象
‎推广新的极端中心
-New EC video to promote. -[Advertising AI] Another ad teed up.
‎再安排一个广告
‎算法和操纵人的政治家 ‎在学习如何激发我们的方面
[Justin] Algorithms and manipulative politicians
are becoming so expert
‎变得非常专业
at learning how to trigger us,
‎非常擅长制造我们容易接受的 ‎虚假新闻 假装这就是事实
getting so good at creating fake news that we absorb as if it were reality,
‎给我们造成混乱 ‎让我们相信这些谎言
and confusing us into believing those lies.
‎我们似乎对自己是怎样的人 ‎自己的信仰 有越来越少的控制权
It's as though we have less and less control
over who we are and what we believe.
[ominous instrumental music playing]
[vlogger] ...so they can pick sides.
‎…来让他们选择站队
‎到处都是谎言
There's lies here, and there's lies over there.
‎这样他们就能保持住权力 ‎这样他们就能控制一切
So they can keep the power,
-so they can control everything. -[police siren blaring]
‎他们可以控制我们的思想 ‎这样他们就可以保守他们的秘密
[vlogger] They can control our minds,
-so that they can keep their secrets. -[crowd chanting]
‎（质疑真相）
‎（疾控中心承认掩盖疫苗/自闭症）
[Tristan] Imagine a world where no one believes anything true.
‎想象一个没有人相信任何真相的世界
‎（疫苗不普适所有人 ‎我们的基因就是证据）
Everyone believes the government's lying to them.
‎所有人都相信 政府在骗他们
‎一切都是阴谋论
Everything is a conspiracy theory.
‎“我不应该相信任何人 ‎我痛恨对立面”
"I shouldn't trust anyone. I hate the other side."
‎一切正在向这个方向发展
That's where all this is heading.
‎欧洲的政治地震 余震不止
The political earthquakes in Europe continue to rumble.
‎这一次 轮到了意大利和西班牙
This time, in Italy and Spain.
‎整体上来说 欧洲传统的 ‎中间派联合政府失去了大多数人支持
[reporter] Overall, Europe's traditional, centrist coalition lost its majority
‎同时极左和极右民粹主义政党 ‎获得更多支持
while far right and far left populist parties made gains.
[man shouts]
[crowd chanting]
‎（中心）
‎退后
Back up.
-[radio beeps] -Okay, let's go.
‎好 我们走
[police siren wailing]
‎这些账户专门故意试图
[reporter] These accounts were deliberately, specifically attempting
‎散播香港政治纷争信息
-to sow political discord in Hong Kong. -[crowd shouting]
[sighs]
‎好 本
-All right, Ben. -[car doors lock]
‎生活在一个全部信息来自于脸书
What does it look like to be a country
‎和社交媒体的国家 是什么感觉？
that's entire diet is Facebook and social media?
‎民主迅速崩溃
Democracy crumbled quickly.
‎六个月
Six months.
‎芝加哥的混乱发生后
[reporter 1] After that chaos in Chicago,
‎抗议者和支持者之间的暴力冲突…
violent clashes between protesters and supporters...
‎民主正面临着信心危机
[reporter 2] Democracy is facing a crisis of confidence.
‎我们看到的 是对全球民主的攻击
What we're seeing is a global assault on democracy.
‎（极端中心）
[crowd shouting]
‎多数目标国家 都是
[Renée] Most of the countries that are targeted are countries
‎进行民主选举的国家
that run democratic elections.
‎大范围发生
[Tristan] This is happening at scale.
‎国家行动者、家财万贯的富翁说
By state actors, by people with millions of dollars saying,
‎“我想让肯尼亚动摇 ‎我想让喀麦隆动摇
"I wanna destabilize Kenya. I wanna destabilize Cameroon.
‎安哥拉？只要这么一点钱”
Oh, Angola? That only costs this much."
‎巴西上周日举行了一场特别的选举
[reporter] An extraordinary election took place Sunday in Brazil.
‎选举动员是社交媒体驱动的
With a campaign that's been powered by social media.
[crowd chanting in Portuguese]
‎我们技术产业的人创造了
[Tristan] We in the tech industry have created the tools
‎动摇和侵蚀社会结构的工具
to destabilize and erode the fabric of society
‎所有国家都在同时发生 ‎世界各地都在发生
in every country, all at once, everywhere.
‎德国、西班牙、法国 ‎巴西、澳大利亚都有发生
You have this in Germany, Spain, France, Brazil, Australia.
‎一些世界上最发达的国家
Some of the most "developed nations" in the world
are now imploding on each other,
‎正在互相爆破
‎他们有什么共同点？
and what do they have in common?
‎基于你当前的了解
Knowing what you know now,
‎你相信脸书 ‎影响了2016年大选的结果吗？
do you believe Facebook impacted the results of the 2016 election?
[Mark Zuckerberg] Oh, that's... that is hard.
‎这个问题好难回答
‎你知道 这个…
You know, it's... the...
‎事实是 ‎有很多不同的力量在产生影响
the reality is, well, there were so many different forces at play.
‎脸书、推特和谷歌的代表们 ‎回到国会山
Representatives from Facebook, Twitter, and Google are back on Capitol Hill
‎对俄罗斯干预2016年大选问题
for a second day of testimony
‎进行第二天的证词发言
about Russia's interference in the 2016 election.
‎第三方政党的操纵没有黑入
The manipulation by third parties is not a hack.
‎对吧？俄罗斯没有黑入脸书
Right? The Russians didn't hack Facebook.
‎他们所做的是 利用脸书 ‎为合法广告商与合法用户创造的工具
What they did was they used the tools that Facebook created
for legitimate advertisers and legitimate users,
‎用到了罪恶的用途中
and they applied it to a nefarious purpose.
‎就像是远程控制的战争
[Tristan] It's like remote-control warfare.
‎一个国家可以操纵另一个国家
One country can manipulate another one
‎都不用真正入侵实体边境
without actually invading its physical borders.
‎我们看到这些暴力的画面
[reporter 1] We're seeing violent images. It appears to be a dumpster
‎这是一个被推来推去的垃圾箱…
being pushed around...
‎但问题不是你想投票给谁
[Tristan] But it wasn't about who you wanted to vote for.
‎问题是在社会中散播混乱和分歧
It was about sowing total chaos and division in society.
‎这是在霍廷顿海滩市的示威…
[reporter 2] Now, this was in Huntington Beach. A march...
‎问题是制造了两个对立面
[Tristan] It's about making two sides
‎丝毫不再听取对方的观点
who couldn't hear each other anymore,
‎不再想听对方的观点
who didn't want to hear each other anymore,
‎不再相信对方
who didn't trust each other anymore.
‎这是仇恨被暴露出
[reporter 3] This is a city where hatred was laid bare
‎并转化成种族暴力的城市
and transformed into racial violence.
‎（弗吉尼亚紧张局势 ‎暴力当天致三人遇害）
[crowd shouting]
[indistinct shouting]
[men grunting]
[police siren blaring]
‎本！
[Cass] Ben!
‎卡桑德拉！
Cassandra!
‎-卡桑！ ‎-本！
-Cass! -Ben!
‎过来！
[officer 1] Come here! Come here!
‎举起手 膝盖跪地 快 跪下
Arms up. Arms up. Get down on your knees. Now, down.
[crowd continues shouting]
‎-冷静…… ‎-本！
-[officer 2] Calm-- -Ben!
‎喂！手举起来！
[officer 2] Hey! Hands up!
‎转过去 趴地上
Turn around. On the ground. On the ground!
-[crowd echoing] -[melancholy piano music playing]
[siren continues wailing]
[Tristan] Do we want this system for sale to the highest bidder?
‎我们希望这个系统 ‎售卖出最高的竞价吗？
‎完全出售民主 ‎你可以控制任何你想控制的思想
For democracy to be completely for sale, where you can reach any mind you want,
‎对特定人群设定谎言 ‎制造文化战争？
target a lie to that specific population, and create culture wars?
‎我们希望这样吗？
Do we want that?
[Marco Rubio] We are a nation of people...
‎我们这个国家的人民…
‎不再和彼此说话了
that no longer speak to each other.
We are a nation of people who have stopped being friends with people
‎我们这个国家的人民 ‎不再和彼此交友了
‎只因为他们在上一次竞选中投票的人
because of who they voted for in the last election.
We are a nation of people who have isolated ourselves
‎我们这个国家的人民孤立了自己
‎只看认同我们的那些频道
to only watch channels that tell us that we're right.
‎我今天想传达的信息是 ‎部落主义正在毁掉我们
My message here today is that tribalism is ruining us.
It is tearing our country apart.
‎它正在撕裂我们这个国家
‎正常的成年人 不可能这样做
It is no way for sane adults to act.
‎如果每个人都有权执着于自己的真相
If everyone's entitled to their own facts,
‎就真没有必要妥协 ‎没有必要让人们团结了
there's really no need for compromise, no need for people to come together.
‎事实上 真的没有必要让人们互动
In fact, there's really no need for people to interact.
‎我们需要对现实有一些共同的理解
We need to have...
some shared understanding of reality. Otherwise, we aren't a country.
‎不然 我们就不是一个国家了
‎（扎克伯格先生）
So, uh, long-term, the solution here is to build more AI tools
‎所以长期来看 解决办法 ‎是建造更多的人工智能工具
‎找到人们使用这些服务的行为模式 ‎这是任何一个真人都做不到的
that find patterns of people using the services that no real person would do.
‎我们允许技术专家 把这个当做一个
We are allowing the technologists to frame this as a problem
‎他们有能力解决的问题呈现
that they're equipped to solve.
‎这是骗人的
That is... That's a lie.
‎人们谈论人工智能 ‎好像人工智能知道真理一样
People talk about AI as if it will know truth.
‎人工智能无法解决这些问题
AI's not gonna solve these problems.
‎人工智能无法解决虚假新闻的问题
AI cannot solve the problem of fake news.
‎谷歌没有选择去说
Google doesn't have the option of saying,
‎“这是阴谋论？这是真相吗？”
"Oh, is this conspiracy? Is this truth?" Because they don't know what truth is.
‎因为它们不知道 真相是什么
They don't have a...
‎它们没有真相的代理服务器 ‎只有点击
They don't have a proxy for truth that's better than a click.
‎如果我们不同意真相
If we don't agree on what is true
‎或者不同意存在真相
or that there is such a thing as truth,
‎我们就完蛋了
we're toast.
‎这是其他问题之下的问题
This is the problem beneath other problems
‎因为如果我们不能认同真相
because if we can't agree on what's true,
‎那我们就无法找到 ‎我们任何一个问题的解决方法
then we can't navigate out of any of our problems.
-[ominous instrumental music playing] -[console droning]
‎我们应该建议他 ‎关注平面地球足球俱乐部
[Growth AI] We should suggest Flat Earth Football Club.
‎别再给他展示运动消息了 ‎他不感兴趣
[Engagement AI] Don't show him sports updates. He doesn't engage.
[AIs speaking indistinctly]
[music swells]
[Jaron] A lot of people in Silicon Valley subscribe to some kind of theory
‎硅谷的很多人相信一种理论
‎我们正在建造一些全球的超级大脑
that we're building some global super brain,
‎我们所有的用户 ‎都只是可交互的神经元
and all of our users are just interchangeable little neurons,
‎他们一点都不重要
no one of which is important.
‎它让人们服从于这样一个奇怪的角色
And it subjugates people into this weird role
‎你就像是一个小的编程元素
where you're just, like, this little computing element
‎我们通过我们的行为操纵去 编程
that we're programming through our behavior manipulation
‎为了服务于这个巨型大脑 ‎你根本不重要
for the service of this giant brain, and you don't matter.
‎不会给你钱 不会告诉你真相
You're not gonna get paid. You're not gonna get acknowledged.
‎你没有自主权
You don't have self-determination.
‎我们会鬼祟地操纵你 ‎因为你是编程中的结点
We'll sneakily just manipulate you because you're a computing node,
‎所以我们需要将你编程 ‎因为我们就要这样对待编程中的结点
so we need to program you 'cause that's what you do with computing nodes.
[reflective instrumental music playing]
‎天啊
Oh, man. [sighs]
‎当你想到技术 ‎技术是一种人类存亡的威胁
[Tristan] When you think about technology and it being an existential threat,
‎这个指控很严重…
you know, that's a big claim, and...
‎然后你的脑中就会很容易想 ‎“好 我正在拿着手机
it's easy to then, in your mind, think, "Okay, so, there I am with the phone...
‎互动、点击、使用
scrolling, clicking, using it.
‎人类存亡的威胁在哪里？
Like, where's the existential threat?
‎好 有一个超级电脑
Okay, there's the supercomputer.
‎在屏幕的另一端 正指向我的大脑
The other side of the screen, pointed at my brain,
‎让我再看一个视频 ‎人类存亡的威胁在哪里？”
got me to watch one more video. Where's the existential threat?"
[indistinct chatter]
‎技术并不是人类存亡的威胁
[Tristan] It's not about the technology
being the existential threat.
‎（劝服性技术 美国参议院听政会）
It's the technology's ability
‎是技术能够把 ‎社会中最坏的东西带出来的能力
to bring out the worst in society... [chuckles]
‎社会中最坏的东西 ‎才是人类存亡的威胁
...and the worst in society being the existential threat.
‎（美国参议院）
‎如果技术创造了公众混乱
If technology creates...
mass chaos,
‎愤怒、无礼
outrage, incivility,
‎彼此缺乏信任
lack of trust in each other,
‎孤独、疏远、更加两极分化
loneliness, alienation, more polarization,
‎更多大选黑入、更多平民政治
more election hacking, more populism,
‎让人更加分散注意力 ‎无法集中在真正的问题上…
more distraction and inability to focus on the real issues...
‎那只是社会
that's just society. [scoffs]
‎现在社会无法自愈
And now society is incapable of healing itself
‎转移成了一种混乱的形式
and just devolving into a kind of chaos.
‎这影响着每一个人 ‎即使你不使用这些产品
This affects everyone, even if you don't use these products.
‎这些事情变成了数码的科学怪人
These things have become digital Frankensteins
‎让这个世界变成他们现象中的样子
that are terraforming the world in their image,
‎不论是儿童的心理健康
whether it's the mental health of children
‎还是我们的政治 我们的政治演说
or our politics and our political discourse,
‎而不用因为控制公众舆论 ‎承担责任
without taking responsibility for taking over the public square.
‎-所以 还是要回到… ‎-你觉得这一切怪谁？
-So, again, it comes back to-- -And who do you think's responsible?
‎我认为我们必须让平台负起责任
I think we have to have the platforms be responsible
‎因为他们接管大选广告的时候
for when they take over election advertising,
‎就要负责保护大选
they're responsible for protecting elections.
‎当他们接管儿童心理健康 ‎或是儿童频道的时候
When they take over mental health of kids or Saturday morning,
‎他们就有责任保护好儿童频道
they're responsible for protecting Saturday morning.
The race to keep people's attention isn't going away.
‎保持人们关注的竞争不会结束
‎我们的技术会在我们生活中更加集成 ‎而不会减少
Our technology's gonna become more integrated into our lives, not less.
‎人工智能会更加擅长预判 ‎什么内容能让我们持续盯着屏幕
The AIs are gonna get better at predicting what keeps us on the screen,
‎而不是做出更差的预判
not worse at predicting what keeps us on the screen.
‎我已经62岁了
I... I am 62 years old,
‎随着这个对话继续进行 ‎我每一分钟都在变老
getting older every minute, the more this conversation goes on...
-[crowd chuckles] -...but... but I will tell you that, um...
‎但我会告诉你
‎到时候我可能已经死了 不在了 ‎但我可能会为此感恩
I'm probably gonna be dead and gone, and I'll probably be thankful for it,
‎因为当这些恐怖的东西结出恶果
when all this shit comes to fruition.
‎我觉得能吓死我
Because... Because I think that this scares me to death.
Do... Do you... Do you see it the same way?
‎你也这样看吗？
‎还是我对一个我不够了解的情况 ‎过度反应了？
Or am I overreacting to a situation that I don't know enough about?
[interviewer] What are you most worried about?
‎你最担心什么？
[sighs] I think, in the... in the shortest time horizon...
‎我认为在最短的时间范围内…
‎是内战
civil war.
‎如果现在的常态继续下去 ‎我们说再过20年
If we go down the current status quo for, let's say, another 20 years...
‎我们很可能会因为故意无知 ‎毁掉我们的文明
we probably destroy our civilization through willful ignorance.
‎我们或许会无法应对气候变化的挑战
We probably fail to meet the challenge of climate change.
‎我们或许会瓦解世界的民主
We probably degrade the world's democracies
‎最终衰落成一种奇怪的独裁机能障碍
so that they fall into some sort of bizarre autocratic dysfunction.
‎我们或许会毁掉全球经济
We probably ruin the global economy.
Uh, we probably, um, don't survive.
‎我们或许会无法存活
‎我真的把它看做 ‎人类生死存亡的大问题
You know, I... I really do view it as existential.
[helicopter blades whirring]
‎这会是知道在这种幻象发生之前
[Tristan] Is this the last generation of people
‎世界是什么样的最后一代人吗？
that are gonna know what it was like before this illusion took place?
‎如果你不知道自己在矩阵中 ‎你要怎么从矩阵中醒来？
Like, how do you wake up from the matrix when you don't know you're in the matrix?
[ominous instrumental music playing]
‎（“不论是乌托邦还是毁灭 ‎都是一场一触即发的接力赛…）
‎（直接通往最后一刻…” ‎——巴克敏斯特·富勒）
‎你知道 我们说的很多话 ‎听起来像是…
[Tristan] A lot of what we're saying sounds like it's just this...
‎片面的悲观
one-sided doom and gloom.
‎“天啊 技术正在毁灭世界
Like, "Oh, my God, technology's just ruining the world
‎正在毁灭孩子们”
and it's ruining kids,"
‎不是这样的
and it's like... "No." [chuckles]
‎这很困惑 ‎因为这同时是乌托邦和毁灭
It's confusing because it's simultaneous utopia...
and dystopia.
‎我可以在手机按一个按钮 ‎30秒后就能出现一辆车
Like, I could hit a button on my phone, and a car shows up in 30 seconds,
‎我就可以去想去的任何地方
and I can go exactly where I need to go.
‎这简直是魔法 太神奇了
That is magic. That's amazing.
‎我们制作“点赞”按钮的时候
When we were making the like button,
‎我们全部的动机是 “我们可以 ‎在世界中传播积极和爱吗？”
our entire motivation was, "Can we spread positivity and love in the world?"
‎时间快进到当下 ‎青少年会因为没有得到足够多的点赞
The idea that, fast-forward to today, and teens would be getting depressed
‎而抑郁 这个想法
when they don't have enough likes,
‎或者会导致政治两极分化
or it could be leading to political polarization
‎当时是完全无法想象的
was nowhere on our radar.
‎我不认为这些人 ‎最开始的目标是邪恶的
I don't think these guys set out to be evil.
‎只是这个商业模式有问题
It's just the business model that has a problem.
‎你可以关掉服务 毁掉不管这是什么
You could shut down the service and destroy whatever it is--
‎200亿美元的股东利益 被起诉…
$20 billion of shareholder value-- and get sued and...
‎但现实是 覆水难收
But you can't, in practice, put the genie back in the bottle.
‎你可以做出一些小的调整 但是最终
You can make some tweaks, but at the end of the day,
‎你要增加收益和使用 ‎每一个季度都要增加
you've gotta grow revenue and usage, quarter over quarter. It's...
‎规模做得越大 越难让任何人改变
The bigger it gets, the harder it is for anyone to change.
‎我看到的是一群被困住的人 ‎被商业模式
What I see is a bunch of people who are trapped by a business model,
‎经济奖励和股东压力困住
an economic incentive, and shareholder pressure
‎几乎无法做其他的任何事情
that makes it almost impossible to do something else.
‎我认为我们应该接受
I think we need to accept that it's okay
‎公司专注于挣钱 是合情合理的
for companies to be focused on making money.
‎不合情合理的是 ‎当没有监管、没有规定、没有竞争
What's not okay is when there's no regulation, no rules,
and no competition,
‎公司在充当实际政府部门
and the companies are acting as sort of de facto governments.
‎然后他们说“我们可以监管自己”
And then they're saying, "Well, we can regulate ourselves."
‎这肯定是骗人的 怎么可能呢
I mean, that's just a lie. That's just ridiculous.
‎经济奖励可以说运营着世界
Financial incentives kind of run the world,
so any solution to this problem
‎所以这个问题的任何解决方案 ‎一定要符合经济奖励
has to realign the financial incentives.
‎这些公司没有需要改变的财政理由
There's no fiscal reason for these companies to change.
‎所以我才认为 我们需要监管
And that is why I think we need regulation.
‎手机公司有无数的关于你的敏感数据
The phone company has tons of sensitive data about you,
‎我们有很多法律去保证 ‎他们不会利用这些数据做错事
and we have a lot of laws that make sure they don't do the wrong things.
‎在数码隐私上 我们几乎没有立法
We have almost no laws around digital privacy, for example.
‎我们可以对数据收集和处理收税
We could tax data collection and processing
‎原理等同于你交水费
the same way that you, for example, pay your water bill
‎监控你自己的用水量
by monitoring the amount of water that you use.
‎让这些公司因为持有的数据资产交税
You tax these companies on the data assets that they have.
‎就能给他们一个财政理由
It gives them a fiscal reason
‎不去获取地球上每一条数据
to not acquire every piece of data on the planet.
‎立法在这方面太落后了
The law runs way behind on these things,
‎但据我所知 当前状况的存在 ‎不是为了保护用户
but what I know is the current situation exists not for the protection of users,
‎而是为了保护这些巨型的
but for the protection of the rights and privileges
‎超级富有公司的权利和特权
of these gigantic, incredibly wealthy companies.
‎我们要一直听从最有钱 ‎最有权力的人吗？
Are we always gonna defer to the richest, most powerful people?
‎还是我们要说
Or are we ever gonna say,
‎“有时候 确实是有国家利益
"You know, there are times when there is a national interest.
‎有时候 人民的利益 用户利益
There are times when the interests of people, of users,
‎其实比一个
is actually more important
‎已经是亿万富翁的人的利益 ‎更加重要？”
than the profits of somebody who's already a billionaire"?
These markets undermine democracy, and they undermine freedom,
‎这些市场削弱了民主 削弱了自由
‎应该对他们进行法律的制裁
and they should be outlawed.
‎这不是激进的提议
This is not a radical proposal.
‎我们有法律制裁的其他市场
There are other markets that we outlaw.
‎我们制裁人类器官贩卖市场
We outlaw markets in human organs.
‎我们制裁人类奴隶市场
We outlaw markets in human slaves.
‎因为它们都有不可避免的破坏性后果
Because they have inevitable destructive consequences.
‎我们生活的世界
We live in a world
‎死去的树比活着的树更有经济价值
in which a tree is worth more, financially, dead than alive,
‎这个世界 死去的鲸 ‎比活着的鲸更有价值
in a world in which a whale is worth more dead than alive.
‎只要我们的经济这样运转
For so long as our economy works in that way
‎公司不受监管
and corporations go unregulated,
‎它们就会继续破坏树木
they're going to continue to destroy trees,
‎继续捕杀鲸
to kill whales,
‎在地球上挖矿 从地下抽石油
to mine the earth, and to continue to pull oil out of the ground,
‎虽然我们知道 这样做会破坏地球
even though we know it is destroying the planet
‎我们知道 这样做会为未来几代人 ‎留下一个更不堪的世界
and we know that it's going to leave a worse world for future generations.
‎这是目光短浅
This is short-term thinking
‎为了利益牺牲一切的信仰
based on this religion of profit at all costs,
‎指望每个 ‎只顾自己私利的公司会突然神奇地
as if somehow, magically, each corporation acting in its selfish interest
‎去产生最好的结果
is going to produce the best result.
‎这已经影响环境很久了
This has been affecting the environment for a long time.
‎恐怖的是 希望这是 ‎压倒骆驼的最后一根稻草
What's frightening, and what hopefully is the last straw
‎让我们作为文明的种族 去幡然醒悟
that will make us wake up as a civilization
‎这个理论最初就有很多缺点
to how flawed this theory has been in the first place
‎让我们看到 我们现在就是树 就是鲸
is to see that now we're the tree, we're the whale.
‎我们的关注就是被挖掘的矿产
Our attention can be mined.
‎如果我们花时间盯着一个屏幕
We are more profitable to a corporation
‎盯着一个广告 对公司而言
if we're spending time staring at a screen,
‎比我们用这个时间
staring at an ad,
‎过自己丰富的生活 更加有利可图
than if we're spending that time living our life in a rich way.
‎我们看到了这样的后果
And so, we're seeing the results of that.
‎我们看到公司利用强大的人工智能
We're seeing corporations using powerful artificial intelligence
‎凌驾在我们的智能之上 ‎研究怎样拉拢我们的关注
to outsmart us and figure out how to pull our attention
‎让我们去看 他们想让我们看的东西
toward the things they want us to look at,
‎而不是让我们看 ‎与我们目标、价值观
rather than the things that are most consistent
‎与我们的生活最为一致的东西
with our goals and our values and our lives.
[static crackles]
‎（史蒂夫·乔布斯 今日演讲者）
[crowd cheering]
‎电脑对我来说 是…
[Steve Jobs] What a computer is,
‎是我们人类历史上 最神奇的发明
is it's the most remarkable tool that we've ever come up with.
‎相当于是我们思想的自行车
And it's the equivalent of a bicycle for our minds.
‎人道技术的创想 是硅谷最初的目标
The idea of humane technology, that's where Silicon Valley got its start.
‎我们已经背离了这个目标 ‎因为这样做比较酷
And we've lost sight of it because it became the cool thing to do,
‎而不是这样做比较正确
as opposed to the right thing to do.
‎网络就是一个奇怪的、可笑的地方
The Internet was, like, a weird, wacky place.
‎它是实验性的
It was experimental.
‎网络上发生着有创意的事情 ‎当然现在也有发生
Creative things happened on the Internet, and certainly, they do still,
‎但是感觉像一个巨大的商场
but, like, it just feels like this, like, giant mall. [chuckles]
‎就是“天啊 ‎肯定不止表面上这么简单”
You know, it's just like, "God, there's gotta be...
there's gotta be more to it than that."
[man typing]
[Bailey] I guess I'm just an optimist.
‎我想我只是一个乐观主义者
‎因为我认为 ‎我们可以改变社交媒体的样子和方式
'Cause I think we can change what social media looks like and means.
‎技术的工作方式不是物理学定律 ‎它不是一成不变的
[Justin] The way the technology works is not a law of physics.
It is not set in stone.
‎这些都是像我这样的人类 ‎做出的选择
These are choices that human beings like myself have been making.
‎人类可以改变这些技术
And human beings can change those technologies.
‎现在的问题是 我们是否愿意承认
[Tristan] And the question now is whether or not we're willing to admit
‎这些后果 是我们杰作的直接产物
that those bad outcomes are coming directly as a product of our work.
‎这些东西是我们建立起来的 ‎我们有责任去改变它们
It's that we built these things, and we have a responsibility to change it.
[static crackling]
[Tristan] The attention extraction model
‎提取关注模型 ‎不是我们想对待人类的方式
is not how we want to treat human beings.
[distorted] Is it just me or...
‎只有我这样想吗？还是…
[distorted] Poor sucker.
‎可悲的人
‎一个健康社会的结构
[Tristan] The fabric of a healthy society
‎要依靠我们脱离这种 ‎有破坏性的商业模型
depends on us getting off this corrosive business model.
[console beeps]
[gentle instrumental music playing]
[console whirs, grows quiet]
‎我们可以要求 ‎这些产品进行人道设计
[Tristan] We can demand that these products be designed humanely.
‎我们可以要求 ‎不被当做可以提取的资源对待
We can demand to not be treated as an extractable resource.
‎我们的动机可以是 ‎“我们怎样让这个世界变得更好？”
The intention could be: "How do we make the world better?"
[Jaron] Throughout history,
‎在整个人类历史中 ‎每一次有事物变得更好
every single time something's gotten better,
‎都是因为有人站出来说
it's because somebody has come along to say,
‎“这太蠢了 我们可以做得更好”
"This is stupid. We can do better." [laughs]
‎是批判者驱动着改进
Like, it's the critics that drive improvement.
‎批判者才是真正的乐观主义者
It's the critics who are the true optimists.
[sighs] Hello.
‎你好
[sighs] Um...
‎感觉有点疯狂 是吧？
I mean, it seems kind of crazy, right?
‎这东西的设计基本方式
It's like the fundamental way that this stuff is designed...
‎就不会朝着好的方向发展
isn't going in a good direction. [chuckles]
‎整个社交媒体
Like, the entire thing.
‎我说要改变这一切 ‎听起来有点疯狂
So, it sounds crazy to say we need to change all that,
‎但我们需要这样做
but that's what we need to do.
[interviewer] Think we're gonna get there?
‎你觉得这一天能实现吗？
‎必须要实现
We have to.
[tense instrumental music playing]
[interviewer] Um, it seems like you're very optimistic.
‎你似乎非常乐观
‎听起来是这样吗？
-Is that how I sound? -[crew laughs]
‎是 我是说… ‎我无法相信你一直这样说
[interviewer] Yeah, I mean...
I can't believe you keep saying that, because I'm like, "Really?
‎因为我在想：“真的吗？” 我感觉 ‎我们正走向毁灭 而不是乌托邦
I feel like we're headed toward dystopia.
‎我感觉我们正在飞速走向毁灭
I feel like we're on the fast track to dystopia,
‎需要一个奇迹 ‎才能让我们走下这条路“
and it's gonna take a miracle to get us out of it."
‎这个奇迹当然是集体意识
And that miracle is, of course, collective will.
‎可我是乐观主义者 ‎我们一定会有办法解决
I am optimistic that we're going to figure it out,
‎但我认为 可能会用很久的时间
but I think it's gonna take a long time.
‎因为不是所有的人都意识到了 ‎这是一个问题
Because not everybody recognizes that this is a problem.
‎我认为当今技术最大的一个失败
I think one of the big failures in technology today
‎是领导力的真正失败
is a real failure of leadership,
‎人们站出来 去公开讨论
of, like, people coming out and having these open conversations
‎不仅是哪些地方进行得好 ‎还应该讨论哪里不完美
about things that... not just what went well, but what isn't perfect
‎才能让有人介入 构建一些新的东西
so that someone can come in and build something new.
‎最终 你知道
At the end of the day, you know,
‎在有足够的公众压力之前 ‎这台机器是绝对不会回头的
this machine isn't gonna turn around until there's massive public pressure.
‎通过这些对话 发出你的声音
By having these conversations and... and voicing your opinion,
‎在一些情况下 通过某些特定的技术
in some cases through these very technologies,
‎我们可以开始改变趋势 ‎我们可以开始改变对话
we can start to change the tide. We can start to change the conversation.
‎听起来可能有点奇怪 ‎但这是我的世界 是我生活的环境
It might sound strange, but it's my world. It's my community.
‎我不恨他们 ‎我不想伤害谷歌或者脸书
I don't hate them. I don't wanna do any harm to Google or Facebook.
‎我只是想改革它们 ‎别让他们毁了世界 你知道吗？
I just want to reform them so they don't destroy the world. You know?
‎我在手机上卸载了很多程序
I've uninstalled a ton of apps from my phone
‎我感觉那些都是浪费时间
that I felt were just wasting my time.
‎所有的社交媒体程序 所有的新程序
All the social media apps, all the news apps,
‎我关掉了通知
and I've turned off notifications
‎所有那些让我手机震动的通知
on anything that was vibrating my leg with information
‎不够及时 对现在我来说 ‎并不重要的信息
that wasn't timely and important to me right now.
‎也正是因为同样的理由 ‎我兜里不放饼干
It's for the same reason I don't keep cookies in my pocket.
‎减少你收到的通知数量
Reduce the number of notifications you get.
‎关掉通知
Turn off notifications.
‎关掉所有应用的通知
Turning off all notifications.
‎我已经不再用谷歌了 ‎我用Qwant搜索引擎
I'm not using Google anymore, I'm using Qwant,
‎这个引擎不会存储你的搜索历史
which doesn't store your search history.
‎永远不要接受 ‎YouTube上给你推荐的视频
Never accept a video recommended to you on YouTube.
‎永远自己去选择 ‎这是另一个抗争的方式
Always choose. That's another way to fight.
‎谷歌浏览器有无数扩展程序 ‎可以移走推荐
There are tons of Chrome extensions that remove recommendations.
‎我很喜欢你推荐一个 ‎撤销你所做东西的东西
[interviewer] You're recommending something to undo what you made.
[laughing] Yep.
‎对
‎在你分享之前 查找一下事实 ‎思考一下信息来源 谷歌搜索一下
Before you share, fact-check, consider the source, do that extra Google.
‎如果这个东西感觉像是 ‎以触发你的情感按钮为目标
If it seems like it's something designed to really push your emotional buttons,
‎很可能确实是
like, it probably is.
‎基本可以说 你用点击去投票
Essentially, you vote with your clicks.
‎如果你点击了钓鱼链接
If you click on clickbait,
‎你就是在创造一个经济奖励 ‎延续这个已经存在的体系
you're creating a financial incentive that perpetuates this existing system.
‎在你的生活中 一定要获得
Make sure that you get lots of different kinds of information
‎各种不同的信息
in your own life.
‎我会在推特上关注我不认同的人
I follow people on Twitter that I disagree with
‎因为我想看到不同的观点
because I want to be exposed to different points of view.
‎要知道 技术行业中的很多人
Notice that many people in the tech industry
‎不会把这些设备给他们自己的小孩用
don't give these devices to their own children.
‎我的孩子们完全不使用社交媒体
My kids don't use social media at all.
[interviewer] Is that a rule, or is that a...
‎这是规定 还是…
‎家规
That's a rule.
‎我们对它很狂热
We are zealots about it.
‎我们很疯狂
We're... We're crazy.
‎我们不会让我们的孩子 ‎拥有任何看屏幕的时间
And we don't let our kids have really any screen time.
‎我想出了 ‎我自己认为的三个简单原则
I've worked out what I think are three simple rules, um,
‎能让生活对家人来说更容易 ‎这是经过研究验证的
that make life a lot easier for families and that are justified by the research.
‎第一个原则是 ‎在每晚的固定时间 所有设备
So, the first rule is all devices out of the bedroom
‎不能进入卧室
at a fixed time every night.
‎不管是什么时间 睡前半小时 ‎所有设备全都拿出去
Whatever the time is, half an hour before bedtime, all devices out.
‎第二个原则是 ‎高中之前禁止使用社交媒体
The second rule is no social media until high school.
‎我个人认为 这个年龄应该是16岁
Personally, I think the age should be 16.
‎初中已经够难了 上高中之前别用了
Middle school's hard enough. Keep it out until high school.
‎第三个原则是 ‎和你的孩子研究出一个时间预算
And the third rule is work out a time budget with your kid.
‎如果你和他们聊 去说
And if you talk with them and say,
‎“你每天想在你的设备上花多少时间
"Well, how many hours a day do you wanna spend on your device?
‎你觉得适合的时长是多少”
What do you think is a good amount?"
‎他们通常会说出一个很合理的时长
they'll often say something pretty reasonable.
‎看 我非常清楚
Well, look, I know perfectly well
‎我无法让所有人删除社交媒体账号
that I'm not gonna get everybody to delete their social media accounts,
‎但我想我可以让几个人这样做
but I think I can get a few.
‎让几个人删除账号 ‎就已经能产生很大影响了
And just getting a few people to delete their accounts matters a lot,
‎理由是 这样能创造一个对话的空间
and the reason why is that that creates the space for a conversation
‎因为我想让社会中有足够的人
because I want there to be enough people out in the society
‎这些人不受到引擎的操纵 ‎能够进行社交对话
who are free of the manipulation engines to have a societal conversation
‎没有受到操纵引擎的牵制
that isn't bounded by the manipulation engines.
‎这样做吧！退出这个体系
So, do it! Get out of the system.
‎对 删掉 下线这个愚蠢的东西
Yeah, delete. Get off the stupid stuff.
‎世界很美丽 你们看 ‎外面的世界很美好
The world's beautiful. Look. Look, it's great out there.
[laughs]
‎（在社交媒体上关注我们！）
‎（开玩笑的）
‎（我们来聊聊怎样解决这个问题 ‎登录TheSocialDilemma.com）
-[birds singing] -[children playing and shouting]
‎字幕翻译：王成成